Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
webscraping
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
I priced 150 flights across November. Tuesday was the cheapest day to fly, Friday cost 20% more.
Hugues Ishema
Hugues Ishema
Hugues Ishema
Follow
Oct 2
I priced 150 flights across November. Tuesday was the cheapest day to fly, Friday cost 20% more.
#
travel
#
webscraping
#
datascience
#
python
1
 reaction
Comments
4
 comments
3 min read
googlenewsdecoder ImportError or 429? Decode Google News RSS links with one API call
hiver
hiver
hiver
Follow
Oct 12
googlenewsdecoder ImportError or 429? Decode Google News RSS links with one API call
#
news
#
python
#
webscraping
#
api
Comments
Add Comment
6 min read
Booking.com ran ~40x more Google ads than Expedia last month. I pulled the ad counts for 8 travel brands.
Hugues Ishema
Hugues Ishema
Hugues Ishema
Follow
Oct 2
Booking.com ran ~40x more Google ads than Expedia last month. I pulled the ad counts for 8 travel brands.
#
marketing
#
webscraping
#
datascience
#
seo
5
 reactions
Comments
Add Comment
4 min read
How to monitor Shopify competitor prices, stock, and product changes
Roman V (RV)
Roman V (RV)
Roman V (RV)
Follow
Sep 23
How to monitor Shopify competitor prices, stock, and product changes
#
shopify
#
ecommerce
#
webscraping
#
apify
1
 reaction
Comments
Add Comment
4 min read
Can You Scrape Real-Time Market Data for Profitable ML Trading?
Pier
Pier
Pier
Follow
Oct 12
Can You Scrape Real-Time Market Data for Profitable ML Trading?
#
webscraping
#
machinelearning
#
finance
#
python
1
 reaction
Comments
1
 comment
17 min read
The 429 Playbook: Handling Rate Limits Before Your IP Gets Banned
Yuhe He
Yuhe He
Yuhe He
Follow
Oct 11
The 429 Playbook: Handling Rate Limits Before Your IP Gets Banned
#
api
#
backend
#
performance
#
webscraping
2
 reactions
Comments
11
 comments
2 min read
An isinstance(str) check that was always False capped every Facebook Page at exactly 3 posts
Devil Scrapes
Devil Scrapes
Devil Scrapes
Follow
Sep 18
An isinstance(str) check that was always False capped every Facebook Page at exactly 3 posts
#
webscraping
#
python
#
api
#
debugging
Comments
Add Comment
4 min read
Building a Self-Healing Scraper: Let AI Fix Your Selectors When Sites Change
Ahmed Shamandy
Ahmed Shamandy
Ahmed Shamandy
Follow
Sep 18
Building a Self-Healing Scraper: Let AI Fix Your Selectors When Sites Change
#
python
#
webscraping
#
ai
#
tutorial
Comments
Add Comment
6 min read
I Broke My Instagram Giveaway Picker With Rate Limits — Here’s What I Learned
Tay Clompson
Tay Clompson
Tay Clompson
Follow
Sep 18
I Broke My Instagram Giveaway Picker With Rate Limits — Here’s What I Learned
#
python
#
webscraping
#
api
Comments
Add Comment
2 min read
Designing Apify Actors that AI agents actually pick (and can afford)
locaihost data
locaihost data
locaihost data
Follow
Oct 10
Designing Apify Actors that AI agents actually pick (and can afford)
#
apify
#
ai
#
mcp
#
webscraping
Comments
10
 comments
10 min read
My URL-to-Markdown API served a nav menu as an 'article' — detecting JS-rendered SPA shell pages
InApp
InApp
InApp
Follow
Oct 1
My URL-to-Markdown API served a nav menu as an 'article' — detecting JS-rendered SPA shell pages
#
webscraping
#
rag
#
markdown
#
ai
Comments
1
 comment
2 min read
Cómo solucionar el error “Enable JavaScript and cookies to continue”
Erick Eduardo Ramos
Erick Eduardo Ramos
Erick Eduardo Ramos
Follow
Sep 17
Cómo solucionar el error “Enable JavaScript and cookies to continue”
#
javascript
#
security
#
webscraping
Comments
Add Comment
3 min read
Proxies in Java: Setting Up HttpClient and OkHttp
ProxiesThatWork
ProxiesThatWork
ProxiesThatWork
Follow
Sep 17
Proxies in Java: Setting Up HttpClient and OkHttp
#
java
#
proxies
#
tutorial
#
webscraping
Comments
Add Comment
4 min read
Jev, the model that cannot write a word, and where it fits in web scraping (does it?)
Ayan Pahwa
Ayan Pahwa
Ayan Pahwa
Follow
for
Extract by Zyte
Sep 21
Jev, the model that cannot write a word, and where it fits in web scraping (does it?)
#
ai
#
webscraping
#
python
#
machinelearning
1
 reaction
Comments
Add Comment
12 min read
Checking hotel prices on every booking site at once (and catching rate parity problems)
ivanpetrus
ivanpetrus
ivanpetrus
Follow
Oct 10
Checking hotel prices on every booking site at once (and catching rate parity problems)
#
travel
#
python
#
webscraping
#
automation
Comments
1
 comment
3 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account