DEV Community

Discussion on: Smart Automatic Web Scraping in Python

Collapse
 
ilyazub profile image
Illia Zub • Edited

Thanks for the autoscraper!

Can you explain an algorithm that builds selectors? As I understand, it finds nodes with the wanted text and builds selectors for the similar nodes.

Collapse
 
alirezamika profile image
Alireza Mika

Yeah, it basically tries to create the chain of nodes from bottom to the top starting with the node containing the wanted text. And after the chain is built, it can traverse it from top to bottom.