Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
webscraping
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Fragrance notes, accords and ratings as JSON, without fighting Fragrantica's Cloudflare
Hao
Hao
Hao
Follow
Jul 24
Fragrance notes, accords and ratings as JSON, without fighting Fragrantica's Cloudflare
#
api
#
webscraping
#
javascript
#
datasets
2
 reactions
Comments
Add Comment
3 min read
Turn a watch reference number into full specs (caliber, case, dial) as JSON
Hao
Hao
Hao
Follow
Jul 24
Turn a watch reference number into full specs (caliber, case, dial) as JSON
#
api
#
webscraping
#
javascript
#
datasets
1
 reaction
Comments
Add Comment
3 min read
Your LLM can scrape the web — locally, without writing throwaway code
Iurii Panarin
Iurii Panarin
Iurii Panarin
Follow
Jul 23
Your LLM can scrape the web — locally, without writing throwaway code
#
mcp
#
ai
#
webscraping
#
go
3
 reactions
Comments
2
 comments
8 min read
What DIY web scraping really costs (2026 TCO breakdown)
PromptCloud
PromptCloud
PromptCloud
Follow
Jun 19
What DIY web scraping really costs (2026 TCO breakdown)
#
dataengineering
#
management
#
softwareengineering
#
webscraping
Comments
Add Comment
7 min read
Building a Python-based Forex Scraper and MCP Server: Forex-Pytory
Ata
Ata
Ata
Follow
Jun 18
Building a Python-based Forex Scraper and MCP Server: Forex-Pytory
#
python
#
opensource
#
webscraping
#
mcp
Comments
Add Comment
1 min read
Why Data Collection Systems Work for 10 Minutes and Fail After 10,000 Requests
Annabelle
Annabelle
Annabelle
Follow
Jun 18
Why Data Collection Systems Work for 10 Minutes and Fail After 10,000 Requests
#
webscraping
#
python
#
backend
#
devops
Comments
Add Comment
6 min read
I added a new feature to a live paid actor — the data was already there, I just wasn't reading it
0xGollum
0xGollum
0xGollum
Follow
Jul 22
I added a new feature to a live paid actor — the data was already there, I just wasn't reading it
#
python
#
webscraping
#
apify
#
buildinpublic
Comments
Add Comment
2 min read
Best Python Libraries for Web Scraping Without Getting Blocked in 2026
Kyle Rhodelander
Kyle Rhodelander
Kyle Rhodelander
Follow
Jun 18
Best Python Libraries for Web Scraping Without Getting Blocked in 2026
#
webscraping
#
python
#
antibotbypass
#
scrapingtools
Comments
Add Comment
7 min read
Choosing Between Scraping APIs, Browser Sessions, and Self-Managed Playwright
Anakin
Anakin
Anakin
Follow
Jun 17
Choosing Between Scraping APIs, Browser Sessions, and Self-Managed Playwright
#
playwright
#
webscraping
#
ai
#
architecture
Comments
Add Comment
5 min read
Building a Resilient Meta Ads Scraper: What Breaks (and What I Learned Fixing It)
Milton Ngeno
Milton Ngeno
Milton Ngeno
Follow
Jun 16
Building a Resilient Meta Ads Scraper: What Breaks (and What I Learned Fixing It)
#
api
#
data
#
softwareengineering
#
webscraping
Comments
Add Comment
4 min read
Google Trends will 429 you into the ground — here's how I got past it
Andrii Votiakov
Andrii Votiakov
Andrii Votiakov
Follow
Jul 19
Google Trends will 429 you into the ground — here's how I got past it
#
webscraping
#
python
#
javascript
#
seo
4
 reactions
Comments
3
 comments
5 min read
Extracting and Organizing Content from Older Websites: A Solution for Structured Documentation Including Mouse-Over Images
Denis Lavrentyev
Denis Lavrentyev
Denis Lavrentyev
Follow
Jun 16
Extracting and Organizing Content from Older Websites: A Solution for Structured Documentation Including Mouse-Over Images
#
webscraping
#
legacywebsites
#
browserautomation
#
dommanipulation
Comments
Add Comment
7 min read
What breaks when you scrape Steam Community Market at scale
0xGollum
0xGollum
0xGollum
Follow
Jul 20
What breaks when you scrape Steam Community Market at scale
#
python
#
webscraping
#
apify
#
buildinpublic
1
 reaction
Comments
5
 comments
2 min read
Async Scraping Jobs Are Usually a Better Fit for RAG Ingestion Than Blocking Requests
Anakin
Anakin
Anakin
Follow
Jun 16
Async Scraping Jobs Are Usually a Better Fit for RAG Ingestion Than Blocking Requests
#
ai
#
rag
#
webscraping
#
architecture
Comments
Add Comment
4 min read
I scraped live betting odds from 9 countries and never once hit a real anti-bot wall
0xGollum
0xGollum
0xGollum
Follow
Jul 20
I scraped live betting odds from 9 countries and never once hit a real anti-bot wall
#
webscraping
#
python
#
api
#
buildinpublic
Comments
Add Comment
3 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account