DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to Get Google, Bing, and Yandex Search Results as JSON

How to Get Google, Bing, and Yandex Search Results as JSON

Comments
2 min read
Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026

Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026

Comments
4 min read
How to Give Your AI Agent Live Web Access Without Feeding It Raw HTML

How to Give Your AI Agent Live Web Access Without Feeding It Raw HTML

Comments
7 min read
I built a free African Stock Market API because the official data cost $19,500/year

I built a free African Stock Market API because the official data cost $19,500/year

Comments
1 min read
How to scrape Google Maps without code: a REST API tutorial

How to scrape Google Maps without code: a REST API tutorial

Comments
5 min read
We Were Scoring 0.1 on reCAPTCHA v3. So We Rewrote Chromium

We Were Scoring 0.1 on reCAPTCHA v3. So We Rewrote Chromium

Comments
3 min read
Rate Limits Are a Feature, Not a Bug

Rate Limits Are a Feature, Not a Bug

Comments
4 min read
Find Jobs on Twitter: How I Built a Hiring Scraper

Find Jobs on Twitter: How I Built a Hiring Scraper

Comments
12 min read
How I Built a SERP Topic Gap Analyzer on Apify (And What the Prefill Bug Taught Me)

How I Built a SERP Topic Gap Analyzer on Apify (And What the Prefill Bug Taught Me)

Comments
4 min read
What Data Should You Store When Tracking Keyword Rankings?

What Data Should You Store When Tracking Keyword Rankings?

Comments
2 min read
Building a Xiaohongshu (RedNote) E-commerce Scraper for RedShop Product Data

Building a Xiaohongshu (RedNote) E-commerce Scraper for RedShop Product Data

Comments
3 min read
HTTP/2 Header Order and Why Browser-Like Requests Still Get Blocked

HTTP/2 Header Order and Why Browser-Like Requests Still Get Blocked

Comments 2
3 min read
Expectation vs Reality (Scraping Edition)

Expectation vs Reality (Scraping Edition)

Comments
1 min read
How We Built a Federal Court Rules Database

How We Built a Federal Court Rules Database

2
Comments 1
6 min read
UOKiK Scraper: Klauzule Niedozwolone z API

UOKiK Scraper: Klauzule Niedozwolone z API

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.