DEV Community

Discussion on: Building a Polite Web Crawler

ladebug5 profile image
LaDeBug • Edited on

I've just recently found out how search engines in general and web crawlers in particular work
Now I'm studying Python and I'm wondering how much time will it take for a junior Python developer to make a decent web crawler.