Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
webscraping
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Why my Reddit scraper went from 92% to 61% success rate in 30 days (and the one-line fix)
Perufitlife
Perufitlife
Perufitlife
Follow
May 17
Why my Reddit scraper went from 92% to 61% success rate in 30 days (and the one-line fix)
#
showdev
#
webscraping
#
reddit
#
apify
Comments
Add Comment
4 min read
How to Scrape Websites with Claude Code (2026 Guide)
Simon
Simon
Simon
Follow
Apr 17
How to Scrape Websites with Claude Code (2026 Guide)
#
claudecode
#
webscraping
#
mcp
#
ai
1
 reaction
Comments
Add Comment
6 min read
Async Python Web Crawler
Sayed Shaun
Sayed Shaun
Sayed Shaun
Follow
May 16
Async Python Web Crawler
#
ai
#
webscraping
#
python
Comments
Add Comment
1 min read
JD.com's isJdSelfRun Flag Is the Best Gray-Market Detection Signal in Chinese E-Commerce (Python Scraper Inside)
Sami
Sami
Sami
Follow
May 15
JD.com's isJdSelfRun Flag Is the Best Gray-Market Detection Signal in Chinese E-Commerce (Python Scraper Inside)
#
python
#
webscraping
#
china
#
ecommerce
Comments
Add Comment
6 min read
I stopped treating headless Chrome like a scraping strategy
Massi
Massi
Massi
Follow
May 15
I stopped treating headless Chrome like a scraping strategy
#
ai
#
webdev
#
llm
#
webscraping
2
 reactions
Comments
Add Comment
5 min read
Firecrawl vs Apify vs DivParser: Picking the Right Web Scraping API in 2026
Solomon Williams
Solomon Williams
Solomon Williams
Follow
May 4
Firecrawl vs Apify vs DivParser: Picking the Right Web Scraping API in 2026
#
ai
#
webscraping
#
programming
#
productivity
1
 reaction
Comments
Add Comment
4 min read
6 Firecrawl Alternatives for Developers in 2026
Tinyfishie
Tinyfishie
Tinyfishie
Follow
May 15
6 Firecrawl Alternatives for Developers in 2026
#
webscraping
#
firecrawl
#
developertools
#
webagents
2
 reactions
Comments
Add Comment
9 min read
What the Scrapy Maintainer Thinks About AI-Generated Scrapers
Neha Setia
Neha Setia
Neha Setia
Follow
for
Extract by Zyte
Apr 11
What the Scrapy Maintainer Thinks About AI-Generated Scrapers
#
ai
#
opensource
#
claude
#
webscraping
Comments
Add Comment
2 min read
Building a Letterboxd Film & Review data pipeline: from raw scrape to first insight
Logiover
Logiover
Logiover
Follow
May 15
Building a Letterboxd Film & Review data pipeline: from raw scrape to first insight
#
webscraping
#
apify
#
socialmedia
#
dataengineering
Comments
Add Comment
3 min read
Comparing approaches to extracting Hacker News Who Is Hiring data
Logiover
Logiover
Logiover
Follow
May 15
Comparing approaches to extracting Hacker News Who Is Hiring data
#
webscraping
#
apify
#
jobs
#
dataengineering
Comments
Add Comment
3 min read
Sample dataset analysis: a 100-row snapshot of Bazaraki
Logiover
Logiover
Logiover
Follow
May 15
Sample dataset analysis: a 100-row snapshot of Bazaraki
#
webscraping
#
apify
#
realestate
#
dataengineering
Comments
Add Comment
3 min read
What I learned scraping Bulk URL Status Checker: schema, gotchas and the tooling that worked
Logiover
Logiover
Logiover
Follow
May 15
What I learned scraping Bulk URL Status Checker: schema, gotchas and the tooling that worked
#
webscraping
#
apify
#
data
#
tutorial
Comments
Add Comment
3 min read
What I learned scraping ClinicalTrials.gov: schema, gotchas and the tooling that worked
Logiover
Logiover
Logiover
Follow
May 15
What I learned scraping ClinicalTrials.gov: schema, gotchas and the tooling that worked
#
webscraping
#
apify
#
opendata
#
tutorial
1
 reaction
Comments
1
 comment
3 min read
Build a RAG Pipeline That Actually Reads the Web
Grady Dillon
Grady Dillon
Grady Dillon
Follow
May 15
Build a RAG Pipeline That Actually Reads the Web
#
ragpipeline
#
generativeaitools
#
python
#
webscraping
Comments
Add Comment
9 min read
Building a Resilient Wayfair Price Monitor: Python Playwright vs. Node.js Puppeteer
Erika S. Adkins
Erika S. Adkins
Erika S. Adkins
Follow
Apr 10
Building a Resilient Wayfair Price Monitor: Python Playwright vs. Node.js Puppeteer
#
playwright
#
python
#
webscraping
#
webdev
Comments
Add Comment
4 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account