Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
webscraping
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
SEC EDGAR Rate Limit and User-Agent: Fair Access Rules
Omar Eldeeb
Omar Eldeeb
Omar Eldeeb
Follow
Oct 14
SEC EDGAR Rate Limit and User-Agent: Fair Access Rules
#
api
#
python
#
finance
#
webscraping
1
 reaction
Comments
1
 comment
6 min read
Moderation
JobSpy doesn't scrape company career sites. Add Greenhouse, Lever and Workday jobs in the same DataFrame
hiver
hiver
hiver
Follow
Oct 14
JobSpy doesn't scrape company career sites. Add Greenhouse, Lever and Workday jobs in the same DataFrame
#
python
#
pandas
#
webscraping
#
jobs
Comments
1
 comment
4 min read
Moderation
Idealo price API: compare shop offers across 6 European markets
LMSlay
LMSlay
LMSlay
Follow
Oct 15
Idealo price API: compare shop offers across 6 European markets
#
api
#
ecommerce
#
webscraping
#
pricing
Comments
Add Comment
7 min read
Moderation
I ran the same Nike search on the Meta Ad Library three times and got three different answers
Agnes Maina
Agnes Maina
Agnes Maina
Follow
Oct 3
I ran the same Nike search on the Meta Ad Library three times and got three different answers
#
webscraping
#
python
#
marketing
#
tutorial
Comments
Add Comment
6 min read
Moderation
How Sinner won Wimbledon 2025, in break points
CleanScrape
CleanScrape
CleanScrape
Follow
Oct 3
How Sinner won Wimbledon 2025, in break points
#
webscraping
#
api
#
datascience
#
tutorial
Comments
Add Comment
4 min read
Moderation
Track competitor prices on any Shopify store with products.json (and catch restocks)
Max Prozapas
Max Prozapas
Max Prozapas
Follow
Oct 14
Track competitor prices on any Shopify store with products.json (and catch restocks)
#
ecommerce
#
shopify
#
webscraping
#
javascript
1
 reaction
Comments
Add Comment
1 min read
Moderation
Java proxy setup: HttpClient, Authenticator and SOCKS5
proxymint
proxymint
proxymint
Follow
Oct 14
Java proxy setup: HttpClient, Authenticator and SOCKS5
#
proxies
#
webscraping
#
tutorial
#
devops
Comments
Add Comment
2 min read
Moderation
11 scrapers for Chinese platforms in 8 days, and my first $4
Silkline
Silkline
Silkline
Follow
Oct 14
11 scrapers for Chinese platforms in 8 days, and my first $4
#
buildinpublic
#
python
#
webscraping
#
sideprojects
Comments
2
 comments
4 min read
Moderation
Asking KAYAK for 10 Flights Instead of 50 Made the Same Seat 30% Dearer
Matvey
Matvey
Matvey
Follow
Oct 14
Asking KAYAK for 10 Flights Instead of 50 Made the Same Seat 30% Dearer
#
webscraping
#
javascript
#
api
#
travel
Comments
Add Comment
6 min read
Moderation
What a data-quality page for scraped price data looks like (and the numbers behind ours)
Russell Yapp
Russell Yapp
Russell Yapp
Follow
Oct 13
What a data-quality page for scraped price data looks like (and the numbers behind ours)
#
datascience
#
webscraping
#
opendata
#
data
1
 reaction
Comments
7
 comments
5 min read
Moderation
How to get AliExpress product variants, stock and shipping as JSON with Python
Serenido
Serenido
Serenido
Follow
Oct 14
How to get AliExpress product variants, stock and shipping as JSON with Python
#
showdev
#
python
#
webscraping
#
ecommerce
Comments
Add Comment
4 min read
Moderation
My Research Journal: I Thought Web Scraping Was the Hard Part
abtahi-tajwar
abtahi-tajwar
abtahi-tajwar
Follow
Sep 10
My Research Journal: I Thought Web Scraping Was the Hard Part
#
webscraping
#
websecurity
#
webbotdetection
#
computerscience
Comments
Add Comment
2 min read
Moderation
Three Supermarkets Spell One Brand Three Ways, So My Price Comparison Never Happened
Matvey
Matvey
Matvey
Follow
Oct 13
Three Supermarkets Spell One Brand Three Ways, So My Price Comparison Never Happened
#
webscraping
#
data
#
javascript
#
api
Comments
2
 comments
7 min read
Moderation
Agoda reviews API: Booking.com reviews via Agoda and event costs
LMSlay
LMSlay
LMSlay
Follow
Oct 13
Agoda reviews API: Booking.com reviews via Agoda and event costs
#
api
#
travel
#
webscraping
#
saas
1
 reaction
Comments
Add Comment
4 min read
Moderation
The Same Song in Two TikToks Came Back as 'Made My Night' and 'Made My Life'
Matvey
Matvey
Matvey
Follow
Oct 13
The Same Song in Two TikToks Came Back as 'Made My Night' and 'Made My Life'
#
python
#
webscraping
#
api
#
machinelearning
Comments
Add Comment
6 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account