DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K
devil_scrapes profile

arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K

#webscraping #python #apify
Comments
7 min read
Google Ads Transparency Scraper: pull any competitor's ads for $1.20/1K
devil_scrapes profile

Google Ads Transparency Scraper: pull any competitor's ads for $1.20/1K

#apify #webscraping #python #marketing
Comments
7 min read
Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)
preet_kaur_ce9be4b533e19d profile

Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)

#python #api #webscraping
Comments
3 min read
Choosing the Right Scraping Interface for LLM Workflows
anakin_writers profile
Anakin

Choosing the Right Scraping Interface for LLM Workflows

#webscraping #llm #api #architecture
1
Comments
4 min read
USPTO Patent Search API: scrape US patents to clean JSON for $3/1K
devil_scrapes profile

USPTO Patent Search API: scrape US patents to clean JSON for $3/1K

#webscraping #python #apify #data
1
Comments
7 min read
How I Built a Google Shopping Scraper with Python & Playwright
partha_singh_448b3a8240aa profile

How I Built a Google Shopping Scraper with Python & Playwright

#showdev #python #playwright #webscraping
Comments
1 min read
How to scrape Nextdoor for hyper-local demographics and community sentiment
eunit profile

How to scrape Nextdoor for hyper-local demographics and community sentiment

#webscraping #leadgen #realestate
5
Comments
9 min read
How China-focused funds turn Weibo into alt-data (Python, 2026)
sami_8858131362756585e4f4 profile
Sami

How China-focused funds turn Weibo into alt-data (Python, 2026)

#python #webscraping #china #datascience
Comments
4 min read
Scraping Without Tests Is Gambling. And the House Always Wins.
sian-agency profile

Scraping Without Tests Is Gambling. And the House Always Wins.

#automation #softwareengineering #testing #webscraping
1
Comments
3 min read
Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic
9proxy profile

Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic

#proxy #anonymousproxies #vpn #webscraping
Comments
7 min read
We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works
da1 profile
so1

We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works

#automation #cpp #security #webscraping
Comments
1 min read
How to scrape Google Play data with Node.js (no API key needed)
freshactors profile

How to scrape Google Play data with Node.js (no API key needed)

#webscraping #api #javascript #tutorial
1
Comments
4 min read
How to scrape Shopify App Store data with Python (no API key needed)
freshactors profile

How to scrape Shopify App Store data with Python (no API key needed)

#webscraping #api #javascript #shopify
Comments
4 min read
When AI Agents Should Stop Using Browsers for Web Data
anakin_writers profile
Anakin

When AI Agents Should Stop Using Browsers for Web Data

#ai #webscraping #api #automation
1
Comments 1
5 min read
reCAPTCHA v2 vs v3 vs Enterprise — how to tell which one you're fighting (and how to solve each)
bshahin profile

reCAPTCHA v2 vs v3 vs Enterprise — how to tell which one you're fighting (and how to solve each)

#webscraping #python #automation #captcha
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.