DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Bing Search API Replacement: scrape SERP results for $1.05/1K

Bing Search API Replacement: scrape SERP results for $1.05/1K

Comments
7 min read
Google AI Overview Tracker: 8-selector battery + citation drift telemetry

Google AI Overview Tracker: 8-selector battery + citation drift telemetry

Comments
8 min read
How to Scrape Reddit Without the API (After the 2023 Price Changes)

How to Scrape Reddit Without the API (After the 2023 Price Changes)

Comments
6 min read
A free proxy list that's actually checked (HTTP/SOCKS4/SOCKS5, updated every 30 min)

A free proxy list that's actually checked (HTTP/SOCKS4/SOCKS5, updated every 30 min)

Comments
2 min read
Rotating proxies for Scrapy, Playwright and requests — one small library

Rotating proxies for Scrapy, Playwright and requests — one small library

Comments
3 min read
Equity Crowdfunding Leads: scrape 4,800+ Wefunder founders for $5/1K

Equity Crowdfunding Leads: scrape 4,800+ Wefunder founders for $5/1K

Comments
7 min read
Bluesky Starter Pack Scraper: export any community list for $2.05/1K

Bluesky Starter Pack Scraper: export any community list for $2.05/1K

Comments
8 min read
DEV.to Scraper: pull articles by tag, author, or feed into clean JSON

DEV.to Scraper: pull articles by tag, author, or feed into clean JSON

Comments
8 min read
ATS Tech Stack Detector: pull company back-end stacks from jobs for $5.05/1K

ATS Tech Stack Detector: pull company back-end stacks from jobs for $5.05/1K

Comments
8 min read
arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K

arXiv Scraper: build a RAG-ready paper corpus for $1.50/1K

Comments
7 min read
Google Ads Transparency Scraper: pull any competitor's ads for $1.20/1K

Google Ads Transparency Scraper: pull any competitor's ads for $1.20/1K

Comments
7 min read
Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)

Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)

Comments
3 min read
Choosing the Right Scraping Interface for LLM Workflows

Choosing the Right Scraping Interface for LLM Workflows

1
Comments
4 min read
USPTO Patent Search API: scrape US patents to clean JSON for $3/1K

USPTO Patent Search API: scrape US patents to clean JSON for $3/1K

1
Comments
7 min read
How I Built a Google Shopping Scraper with Python & Playwright

How I Built a Google Shopping Scraper with Python & Playwright

Comments
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.