DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Web Scraping Challenges: 8 Obstacles and How to Fix Them

Web Scraping Challenges: 8 Obstacles and How to Fix Them

Comments
5 min read
GeeTest v3: why your slider automation keeps failing the second check

GeeTest v3: why your slider automation keeps failing the second check

Comments
5 min read
Google Hotels showed me two different prices 12 seconds apart

Google Hotels showed me two different prices 12 seconds apart

Comments
2 min read
How to Scrape Job Listings from Workday Career Sites (Without Writing a Scraper)

How to Scrape Job Listings from Workday Career Sites (Without Writing a Scraper)

Comments
2 min read
Scraping YouTube comments without the API quota (and the bug where 300 comments meant one thread)

Scraping YouTube comments without the API quota (and the bug where 300 comments meant one thread)

Comments
3 min read
Six of my collectors returned zero. Three of them were never blocked. published: false

Six of my collectors returned zero. Three of them were never blocked. published: false

Comments
4 min read
How to find local businesses missing SSL or schema markup

How to find local businesses missing SSL or schema markup

Comments 1
5 min read
I stopped scraping Instagram myself — now profile lookups cost me $0.10 per 1K

I stopped scraping Instagram myself — now profile lookups cost me $0.10 per 1K

Comments 1
2 min read
How to get all open jobs from a list of companies (Greenhouse, Lever, Ashby) in one spreadsheet

How to get all open jobs from a list of companies (Greenhouse, Lever, Ashby) in one spreadsheet

Comments
4 min read
What I Learned After My Instagram Scraper Broke While Vetting Influencers

What I Learned After My Instagram Scraper Broke While Vetting Influencers

Comments
2 min read
How to Export Remote Job Salary Data to CSV (Himalayas + Remote OK)

How to Export Remote Job Salary Data to CSV (Himalayas + Remote OK)

Comments
2 min read
Datacenter vs residential proxies: which fits the target

Datacenter vs residential proxies: which fits the target

Comments
2 min read
I measured how many pages fit in 1 GB of proxy traffic

I measured how many pages fit in 1 GB of proxy traffic

Comments
3 min read
What a data analyst earns in New York, Chicago and Austin, from 150 Google Jobs listings

What a data analyst earns in New York, Chicago and Austin, from 150 Google Jobs listings

Comments
2 min read
Indeed API alternative in 2026: 100 Chicago nurse jobs, 100 full descriptions, no login

Indeed API alternative in 2026: 100 Chicago nurse jobs, 100 full descriptions, no login

Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.