DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building a Stock Trend Predictor for a Market That Has No API

Building a Stock Trend Predictor for a Market That Has No API

Comments 1
6 min read
How we built an autonomous auditing engine with Playwright without melting our backend

How we built an autonomous auditing engine with Playwright without melting our backend

1
Comments
1 min read
I Built a SaaS Risk Scanner That Collects 35+ Signals Per Vendor. Here's What I Learned About Scraping, LLMs, and Solo Engineering.

I Built a SaaS Risk Scanner That Collects 35+ Signals Per Vendor. Here's What I Learned About Scraping, LLMs, and Solo Engineering.

Comments 1
8 min read
Find Jobs on Twitter: How I Built a Hiring Scraper

Find Jobs on Twitter: How I Built a Hiring Scraper

Comments
12 min read
When a scraping platform is too much for an LLM workflow

When a scraping platform is too much for an LLM workflow

1
Comments
4 min read
What Data Should You Store When Tracking Keyword Rankings?

What Data Should You Store When Tracking Keyword Rankings?

Comments
2 min read
Your scraper is not failing. It is being lied to.

Your scraper is not failing. It is being lied to.

2
Comments
6 min read
Building a Unified Korean Entertainment Database from 10 APIs and Web Scrapers

Building a Unified Korean Entertainment Database from 10 APIs and Web Scrapers

2
Comments
8 min read
Expectation vs Reality (Scraping Edition)

Expectation vs Reality (Scraping Edition)

Comments
1 min read
I Built an AI Extraction API, Got Zero Paying Users, Then Rebuilt the Whole Engine

I Built an AI Extraction API, Got Zero Paying Users, Then Rebuilt the Whole Engine

1
Comments
3 min read
From a Single IP to Exfiltrated Passwords in a PNG: My First Freelance Pentest Engagement

From a Single IP to Exfiltrated Passwords in a PNG: My First Freelance Pentest Engagement

Comments
13 min read
You're Using ScraperAPI or Scrape.do. You're Still Writing Parsers. There's a Better Way.

You're Using ScraperAPI or Scrape.do. You're Still Writing Parsers. There's a Better Way.

1
Comments
3 min read
How to Use Web Scraping Templates the Right Way (2026)

How to Use Web Scraping Templates the Right Way (2026)

Comments
9 min read
Your recurring scraper is re-downloading data that didn't change. Here's the 15-line fix (conditional GET)

Your recurring scraper is re-downloading data that didn't change. Here's the 15-line fix (conditional GET)

2
Comments
5 min read
I Built a Telegram Bot That Searches, Monitors Prices and Lets You Buy and Sell. Here's How

I Built a Telegram Bot That Searches, Monitors Prices and Lets You Buy and Sell. Here's How

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.