DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
pytrends is dead. Here is how Google Trends actually loads data in 2026 (including Trending Now)

pytrends is dead. Here is how Google Trends actually loads data in 2026 (including Trending Now)

Comments
4 min read
Scraping the Google Ads Transparency Center without a browser (and reading image ads with OCR)

Scraping the Google Ads Transparency Center without a browser (and reading image ads with OCR)

Comments
5 min read
Turn Web Content Into Structured Data With Parse_JSON

Turn Web Content Into Structured Data With Parse_JSON

Comments
7 min read
How to Audit a Proxy Vendor's Numbers Before You Pay

How to Audit a Proxy Vendor's Numbers Before You Pay

Comments
5 min read
A marketplace price is retail, not cost: how not to build margin on the wrong number

A marketplace price is retail, not cost: how not to build margin on the wrong number

Comments 1
2 min read
Exporting Modern Web Tables Without Uploading Your Data

Exporting Modern Web Tables Without Uploading Your Data

Comments
2 min read
A one-step probe told us YouTube was blocked. It was asking the wrong endpoint.

A one-step probe told us YouTube was blocked. It was asking the wrong endpoint.

Comments
4 min read
I logged every status code scraping eBay sold listings. The block is not where you think

I logged every status code scraping eBay sold listings. The block is not where you think

1
Comments 2
3 min read
The 200 that is not a result: how to verify without fooling yourself

The 200 that is not a result: how to verify without fooling yourself

Comments
2 min read
A TikTok Shop API for public product data: price, units sold and stock per SKU as JSON

A TikTok Shop API for public product data: price, units sold and stock per SKU as JSON

Comments
3 min read
How to export any public Telegram channel to JSON and read it in English (no login, no bot token)

How to export any public Telegram channel to JSON and read it in English (no login, no bot token)

Comments 1
6 min read
How to Build a B2B Contact List from Company Websites Responsibly

How to Build a B2B Contact List from Company Websites Responsibly

Comments 3
10 min read
OkHttp proxy: auth, SOCKS5, rotation and 407 fixes

OkHttp proxy: auth, SOCKS5, rotation and 407 fixes

Comments
2 min read
Find best-selling AliExpress products by exact order count with Python

Find best-selling AliExpress products by exact order count with Python

Comments
3 min read
The Missing Piece: Adding Link Extraction to a Two-Pass Grading Pipeline

The Missing Piece: Adding Link Extraction to a Two-Pass Grading Pipeline

Comments 1
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.