DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
When your web extraction tool should fail loudly instead of returning pretty lies
zee_builds profile
Zee

When your web extraction tool should fail loudly instead of returning pretty lies

#python #webscraping #ai #mcp
2
Comments
3 min read
What I Learned After Testing Different Proxy Setups for Web Scraping
sebastian_rantala_1e41c8f profile

What I Learned After Testing Different Proxy Setups for Web Scraping

#automation #networking #performance #webscraping
Comments
2 min read
Real-Browser Agent Prompts: 6 AI Workflows for Market Research, Competitor Research, and Brand Monitoring
eliofbm profile
Eli

Real-Browser Agent Prompts: 6 AI Workflows for Market Research, Competitor Research, and Brand Monitoring

#agents #ai #automation #webscraping
1
Comments
6 min read
Why Data Contracts Will Replace Ad-Hoc Scraping Pipelines
promptcloud_services profile

Why Data Contracts Will Replace Ad-Hoc Scraping Pipelines

#webscraping
Comments
5 min read
How to tell if a page uses JavaScript rendering (and what to do about it)
john_rooney profile

How to tell if a page uses JavaScript rendering (and what to do about it)

#webscraping #zyte #programming #rendering
Comments
11 min read
I built a competitor pricing monitor in 3 days, here's how it actually works
erramix01 profile

I built a competitor pricing monitor in 3 days, here's how it actually works

#showdev #automation #nextjs #webscraping
Comments
2 min read
How I Built a 12-Tool MCP Server for AI Agents in 4 Hours (and What It Taught Me About 2026 Scraping)
perufitlife profile

How I Built a 12-Tool MCP Server for AI Agents in 4 Hours (and What It Taught Me About 2026 Scraping)

#mcp #webscraping #ai #javascript
Comments
4 min read
I built a free African Stock Market API because the official data cost $19,500/year
kdab34 profile

I built a free African Stock Market API because the official data cost $19,500/year

#showdev #api #typescript #webscraping
1
Comments
1 min read
Three memory-leak patterns in long-running scrapers (and how I caught them after 968 Trustpilot runs)
0012303 profile

Three memory-leak patterns in long-running scrapers (and how I caught them after 968 Trustpilot runs)

#webscraping #python #ai #apify
1
Comments 2
4 min read
Event-Driven Scraping vs Cron Jobs: What Actually Works at Scale
promptcloud_services profile

Event-Driven Scraping vs Cron Jobs: What Actually Works at Scale

#webscraping
Comments
5 min read
Fighting Google Recorder’s export wall
seithx profile

Fighting Google Recorder’s export wall

#node #cli #webscraping #a11y
Comments
2 min read
The Apify Actor Execution Lifecycle: 8 Decision Engines
apify_forge profile

The Apify Actor Execution Lifecycle: 8 Decision Engines

#apify #developertools #webscraping #mcpservers
Comments
18 min read
How Proxy Rotation Fails When Your TLS Fingerprint Is Wrong
ellebanna profile

How Proxy Rotation Fails When Your TLS Fingerprint Is Wrong

#webscraping #python #devops #backend
Comments
3 min read
Monitoring the Chinese Social Media Ecosystem: RedNote, Weibo & Bilibili Data Pipeline
sami_8858131362756585e4f4 profile
Sami

Monitoring the Chinese Social Media Ecosystem: RedNote, Weibo & Bilibili Data Pipeline

#webscraping #china #api #marketing
Comments
5 min read
Building a Lightweight Media Downloader with Modern Web Techniques (Pinterest Case Study)
loxtmozzi profile

Building a Lightweight Media Downloader with Modern Web Techniques (Pinterest Case Study)

#javascript #tutorial #webdev #webscraping
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.