DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building a Lightweight Media Downloader with Modern Web Techniques (Pinterest Case Study)
loxtmozzi profile

Building a Lightweight Media Downloader with Modern Web Techniques (Pinterest Case Study)

#javascript #tutorial #webdev #webscraping
Comments
3 min read
Track brand mentions across China's top 5 social platforms in one API call — $0.045 per mention
sami_8858131362756585e4f4 profile
Sami

Track brand mentions across China's top 5 social platforms in one API call — $0.045 per mention

#webscraping #apify #china #marketing
Comments
10 min read
Why JSON Schema Validation Isn't Enough for Apify Actors
apify_forge profile

Why JSON Schema Validation Isn't Enough for Apify Actors

#developertools #apify #webscraping #ppepricing
1
Comments
18 min read
Why your scraper plateaus at 5-6 concurrent Chrome instances (and the shared-cookie trap nobody names)
double_chen_70da460344c73 profile

Why your scraper plateaus at 5-6 concurrent Chrome instances (and the shared-cookie trap nobody names)

#webscraping #chrome #automation #performance
Comments
4 min read
I Built an API That Lets AI Agents See the Web Like Humans Do
rtsubber profile

I Built an API That Lets AI Agents See the Web Like Humans Do

#api #ai #webscraping #launch
Comments
3 min read
Facebook scrambles author names with Flexbox order — here's the 5-line diagnostic that proves it isn't custom fonts
leonting1010 profile
Leon

Facebook scrambles author names with Flexbox order — here's the 5-line diagnostic that proves it isn't custom fonts

#webscraping #javascript #webdev #tutorial
Comments
5 min read
5 Apify webhook patterns that turn one-off scrapers into reliable data pipelines
0012303 profile

5 Apify webhook patterns that turn one-off scrapers into reliable data pipelines

#webscraping #python #apify #tutorial
1
Comments
5 min read
The Hidden Problem Behind Technical SEO Crawlers: URL Explosion
aamir_sahil profile

The Hidden Problem Behind Technical SEO Crawlers: URL Explosion

#algorithms #performance #systemdesign #webscraping
1
Comments 1
1 min read
QuickCommerce API
lazydrago profile

QuickCommerce API

#showdev #api #sideprojects #webscraping
1
Comments
1 min read
BeautifulSoup and Requests for Web Scraping With Python: When Simple Still Works
ellebanna profile

BeautifulSoup and Requests for Web Scraping With Python: When Simple Still Works

#webscraping #python #backend #devops
Comments
4 min read
Open-source Playwright wrapper that passes bot.sannysoft.com, pixelscan, and CreepJS in headless mode
shanewas profile

Open-source Playwright wrapper that passes bot.sannysoft.com, pixelscan, and CreepJS in headless mode

#automation #opensource #python #webscraping
1
Comments 2
1 min read
NYTimes वीडियो स्ट्रीमिंग का विश्लेषण: HLS और FFmpeg के साथ एक हाई-परफॉर्मेंस एक्सट्रैक्शन इंजन का निर्माण
yqqwe profile

NYTimes वीडियो स्ट्रीमिंग का विश्लेषण: HLS और FFmpeg के साथ एक हाई-परफॉर्मेंस एक्सट्रैक्शन इंजन का निर्माण

#showdev #architecture #performance #webscraping
Comments
1 min read
Puppeteer networkidle is not a scraping strategy
0xmassi profile

Puppeteer networkidle is not a scraping strategy

#webscraping #javascript #puppeteer #playwright
2
Comments 2
5 min read
Why Playwright Gets You Blocked Even With Proxies
tanwydd profile

Why Playwright Gets You Blocked Even With Proxies

#python #playwright #webscraping #cybersecurity
Comments
4 min read
Korea's #1 Real Estate Platform Has No Official API — So I Built a Scraper. Then Got Blocked.
sessionzero_ai profile

Korea's #1 Real Estate Platform Has No Official API — So I Built a Scraper. Then Got Blocked.

#webdev #apify #korea #webscraping
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.