DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to scrape Google Maps without code: a REST API tutorial

How to scrape Google Maps without code: a REST API tutorial

Comments
5 min read
Building a Lean, Single-Worker Broken URL Monitor for Data Pipelines

Building a Lean, Single-Worker Broken URL Monitor for Data Pipelines

Comments
7 min read
Rate Limits Are a Feature, Not a Bug

Rate Limits Are a Feature, Not a Bug

Comments
4 min read
Building a Stock Trend Predictor for a Market That Has No API

Building a Stock Trend Predictor for a Market That Has No API

Comments 1
6 min read
How we built an autonomous auditing engine with Playwright without melting our backend

How we built an autonomous auditing engine with Playwright without melting our backend

1
Comments
1 min read
I Built a SaaS Risk Scanner That Collects 35+ Signals Per Vendor. Here's What I Learned About Scraping, LLMs, and Solo Engineering.

I Built a SaaS Risk Scanner That Collects 35+ Signals Per Vendor. Here's What I Learned About Scraping, LLMs, and Solo Engineering.

Comments 1
8 min read
Find Jobs on Twitter: How I Built a Hiring Scraper

Find Jobs on Twitter: How I Built a Hiring Scraper

Comments
12 min read
When a scraping platform is too much for an LLM workflow

When a scraping platform is too much for an LLM workflow

1
Comments
4 min read
What Data Should You Store When Tracking Keyword Rankings?

What Data Should You Store When Tracking Keyword Rankings?

Comments
2 min read
Your scraper is not failing. It is being lied to.

Your scraper is not failing. It is being lied to.

2
Comments
6 min read
Expectation vs Reality (Scraping Edition)

Expectation vs Reality (Scraping Edition)

Comments
1 min read
I Built an AI Extraction API, Got Zero Paying Users, Then Rebuilt the Whole Engine

I Built an AI Extraction API, Got Zero Paying Users, Then Rebuilt the Whole Engine

1
Comments
3 min read
From a Single IP to Exfiltrated Passwords in a PNG: My First Freelance Pentest Engagement

From a Single IP to Exfiltrated Passwords in a PNG: My First Freelance Pentest Engagement

Comments
13 min read
You're Using ScraperAPI or Scrape.do. You're Still Writing Parsers. There's a Better Way.

You're Using ScraperAPI or Scrape.do. You're Still Writing Parsers. There's a Better Way.

1
Comments
3 min read
Building Anti-Bot Detection Systems: How RepoHunter Scrapes GitHub Trending Repositories

Building Anti-Bot Detection Systems: How RepoHunter Scrapes GitHub Trending Repositories

Comments 1
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.