DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I priced 150 flights across November. Tuesday was the cheapest day to fly, Friday cost 20% more.

I priced 150 flights across November. Tuesday was the cheapest day to fly, Friday cost 20% more.

1
Comments 4
3 min read
googlenewsdecoder ImportError or 429? Decode Google News RSS links with one API call

googlenewsdecoder ImportError or 429? Decode Google News RSS links with one API call

Comments
6 min read
Booking.com ran ~40x more Google ads than Expedia last month. I pulled the ad counts for 8 travel brands.

Booking.com ran ~40x more Google ads than Expedia last month. I pulled the ad counts for 8 travel brands.

5
Comments
4 min read
How to monitor Shopify competitor prices, stock, and product changes

How to monitor Shopify competitor prices, stock, and product changes

1
Comments
4 min read
Can You Scrape Real-Time Market Data for Profitable ML Trading?

Can You Scrape Real-Time Market Data for Profitable ML Trading?

1
Comments 1
17 min read
The 429 Playbook: Handling Rate Limits Before Your IP Gets Banned

The 429 Playbook: Handling Rate Limits Before Your IP Gets Banned

2
Comments 11
2 min read
An isinstance(str) check that was always False capped every Facebook Page at exactly 3 posts

An isinstance(str) check that was always False capped every Facebook Page at exactly 3 posts

Comments
4 min read
Building a Self-Healing Scraper: Let AI Fix Your Selectors When Sites Change

Building a Self-Healing Scraper: Let AI Fix Your Selectors When Sites Change

Comments
6 min read
I Broke My Instagram Giveaway Picker With Rate Limits — Here’s What I Learned

I Broke My Instagram Giveaway Picker With Rate Limits — Here’s What I Learned

Comments
2 min read
Designing Apify Actors that AI agents actually pick (and can afford)

Designing Apify Actors that AI agents actually pick (and can afford)

Comments 10
10 min read
My URL-to-Markdown API served a nav menu as an 'article' — detecting JS-rendered SPA shell pages

My URL-to-Markdown API served a nav menu as an 'article' — detecting JS-rendered SPA shell pages

Comments 1
2 min read
Cómo solucionar el error “Enable JavaScript and cookies to continue”

Cómo solucionar el error “Enable JavaScript and cookies to continue”

Comments
3 min read
Proxies in Java: Setting Up HttpClient and OkHttp

Proxies in Java: Setting Up HttpClient and OkHttp

Comments
4 min read
Jev, the model that cannot write a word, and where it fits in web scraping (does it?)

Jev, the model that cannot write a word, and where it fits in web scraping (does it?)

1
Comments
12 min read
Checking hotel prices on every booking site at once (and catching rate parity problems)

Checking hotel prices on every booking site at once (and catching rate parity problems)

Comments 1
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.