DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K
devil_scrapes profile

arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K

#webscraping #python #apify
Comments
7 min read
Google Ads Transparency Scraper: pull any competitor's ads for $1.20/1K
devil_scrapes profile

Google Ads Transparency Scraper: pull any competitor's ads for $1.20/1K

#apify #webscraping #python #marketing
Comments
7 min read
Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)
preet_kaur_ce9be4b533e19d profile

Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)

#python #api #webscraping
Comments
3 min read
Choosing the Right Scraping Interface for LLM Workflows
anakin_writers profile
Anakin

Choosing the Right Scraping Interface for LLM Workflows

#webscraping #llm #api #architecture
1
Comments
4 min read
USPTO Patent Search API: scrape US patents to clean JSON for $3/1K
devil_scrapes profile

USPTO Patent Search API: scrape US patents to clean JSON for $3/1K

#webscraping #python #apify #data
1
Comments
7 min read
I Tested Every Web Scraping Tool Against Lazada — Here's What Actually Works (May 2026)
mariatanbobo profile

I Tested Every Web Scraping Tool Against Lazada — Here's What Actually Works (May 2026)

#webscraping #python #ai #devops
Comments
7 min read
The 7 Best Reddit Scrapers in 2026 (Free & Paid, Tested)
benthepythondev profile
Ben

The 7 Best Reddit Scrapers in 2026 (Free & Paid, Tested)

#webscraping #api #datascience #python
Comments
5 min read
How I Built a Google Shopping Scraper with Python & Playwright
partha_singh_448b3a8240aa profile

How I Built a Google Shopping Scraper with Python & Playwright

#showdev #python #playwright #webscraping
Comments
1 min read
How to scrape Nextdoor for hyper-local demographics and community sentiment
eunit profile

How to scrape Nextdoor for hyper-local demographics and community sentiment

#webscraping #leadgen #realestate
5
Comments
9 min read
How China-focused funds turn Weibo into alt-data (Python, 2026)
sami_8858131362756585e4f4 profile
Sami

How China-focused funds turn Weibo into alt-data (Python, 2026)

#python #webscraping #china #datascience
Comments
4 min read
Scraping Without Tests Is Gambling. And the House Always Wins.
sian-agency profile

Scraping Without Tests Is Gambling. And the House Always Wins.

#automation #softwareengineering #testing #webscraping
1
Comments
3 min read
Give Your AI Agent a Web-Fetch Tool: a 60-Line MCP Server (Free, Self-Hosted)
0012303 profile

Give Your AI Agent a Web-Fetch Tool: a 60-Line MCP Server (Free, Self-Hosted)

#webscraping #python #ai #mcp
Comments 2
10 min read
Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic
9proxy profile

Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic

#proxy #anonymousproxies #vpn #webscraping
Comments
7 min read
We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works
da1 profile
so1

We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works

#automation #cpp #security #webscraping
Comments
1 min read
How to scrape Google Play data with Node.js (no API key needed)
freshactors profile

How to scrape Google Play data with Node.js (no API key needed)

#webscraping #api #javascript #tutorial
1
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.