DEV Community

Discussion on: Build a simple python web crawler

Collapse
 
adamant11 profile image
Adamant11

In addition to scraping, you do need a proxy in most of the cases. Smartproxy seems to have the best cost to quality ratio at the moment. Are you covering your proxies?