DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
ytscrape: One Python Interface for YouTube Data — No Browser, No API Key

ytscrape: One Python Interface for YouTube Data — No Browser, No API Key

Comments
5 min read
I built a tiny HTTP gateway so agents get structured JSON from any URL

I built a tiny HTTP gateway so agents get structured JSON from any URL

Comments
1 min read
I wrote a scraper for a government agency's announcements — and learned why boring tools win

I wrote a scraper for a government agency's announcements — and learned why boring tools win

Comments 2
3 min read
I shipped a Tokopedia scraper that undercuts the incumbents 5x — here's the boring part

I shipped a Tokopedia scraper that undercuts the incumbents 5x — here's the boring part

Comments 2
2 min read
We ran our benchmark five times and we have no number to publish

We ran our benchmark five times and we have no number to publish

Comments
7 min read
Skip LinkedIn/Indeed: most companies' job boards have a public JSON API

Skip LinkedIn/Indeed: most companies' job boards have a public JSON API

Comments
2 min read
Find people asking for what you sell, using LinkedIn post search

Find people asking for what you sell, using LinkedIn post search

1
Comments 1
5 min read
My evidence pipeline was saving Cloudflare block pages as evidence

My evidence pipeline was saving Cloudflare block pages as evidence

Comments 3
4 min read
How I Built a Freelance & Bounty Job Aggregator API with FastAPI

How I Built a Freelance & Bounty Job Aggregator API with FastAPI

1
Comments
2 min read
You can tell which ATS a company uses by looking at its careers URL

You can tell which ATS a company uses by looking at its careers URL

Comments
5 min read
How to Scrape Airbnb Market Data (Prices, Ratings, Availability) at Scale

How to Scrape Airbnb Market Data (Prices, Ratings, Availability) at Scale

Comments
3 min read
I scraped 503 jobs from Gulf company career pages. Here's who is actually hiring.

I scraped 503 jobs from Gulf company career pages. Here's who is actually hiring.

Comments
4 min read
How to scrape jobs from any company career page (Greenhouse, Lever, Ashby, Workday)

How to scrape jobs from any company career page (Greenhouse, Lever, Ashby, Workday)

Comments
4 min read
Building a Web Scraper That Survives: Anti-Bot Evasion Tactics

Building a Web Scraper That Survives: Anti-Bot Evasion Tactics

1
Comments
2 min read
I Built a Canada Product Recalls & Safety Alerts Scraper That Reads Open Government Data

I Built a Canada Product Recalls & Safety Alerts Scraper That Reads Open Government Data

Comments 2
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.