DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Track Peptide & GLP-1 Mentions on YouTube with Python (No API Key)

Track Peptide & GLP-1 Mentions on YouTube with Python (No API Key)

Comments
6 min read
Cointelegraph API: Get Crypto News as JSON Without a Key

Cointelegraph API: Get Crypto News as JSON Without a Key

Comments
7 min read
Scrape Monthly vs Annual SaaS Prices From Pricing-Page JSON-LD

Scrape Monthly vs Annual SaaS Prices From Pricing-Page JSON-LD

Comments
7 min read
374 of 820 Google News Rows Were Published at Exactly 07:00:00Z. All but One Were Over a Week Old

374 of 820 Google News Rows Were Published at Exactly 07:00:00Z. All but One Were Over a Week Old

Comments 1
8 min read
Detect a website's tech stack in bulk with Python (a Wappalyzer-style lookup)

Detect a website's tech stack in bulk with Python (a Wappalyzer-style lookup)

Comments
4 min read
How to Export Google Ads Transparency Center Data (with Ad Copy) in Python

How to Export Google Ads Transparency Center Data (with Ad Copy) in Python

Comments 3
6 min read
Storing Scraped Data: CSV, JSONL, or SQLite Before Your Pipeline Bends

Storing Scraped Data: CSV, JSONL, or SQLite Before Your Pipeline Bends

Comments 2
3 min read
We configured residential proxies on our MCP server. They did nothing. Six releases later.

We configured residential proxies on our MCP server. They did nothing. Six releases later.

1
Comments 1
11 min read
pytrends is dead. Here's a maintained drop-in replacement

pytrends is dead. Here's a maintained drop-in replacement

Comments
2 min read
Scraping YouTube transcripts at scale for RAG (and the 3 things that break it)

Scraping YouTube transcripts at scale for RAG (and the 3 things that break it)

Comments 1
4 min read
Export Olive Young and Naver Shopping reviews into one JSON schema

Export Olive Young and Naver Shopping reviews into one JSON schema

Comments
2 min read
Getting Started With Python Web Scraping: Tools, Tips & Code

Getting Started With Python Web Scraping: Tools, Tips & Code

31
Comments 20
10 min read
Scraping Google News search results with the public RSS feed (no API key, no browser)

Scraping Google News search results with the public RSS feed (no API key, no browser)

Comments
3 min read
Scrape Wikipedia in 4mâ™­ (four minutes flat)

Scrape Wikipedia in 4mâ™­ (four minutes flat)

Comments
6 min read
Google Ads Transparency Center API: export a competitor's Google ads

Google Ads Transparency Center API: export a competitor's Google ads

5
Comments 4
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.