DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
I Turned My Browser Into a Terminal — And Now I Can Control Any Website From the Command Line
tenglongai2026 profile

I Turned My Browser Into a Terminal — And Now I Can Control Any Website From the Command Line

#opensource #cli #webscraping #productivity
5
Comments 4
2 min read
How to Scrape Reddit Without the API (After the 2023 Price Changes)
odeeb profile

How to Scrape Reddit Without the API (After the 2023 Price Changes)

#webscraping #python #api #datascience
Comments
7 min read
Discogs Price Scraper: pull every marketplace listing as clean JSON
devil_scrapes profile

Discogs Price Scraper: pull every marketplace listing as clean JSON

#webscraping #python #apify #music
1
Comments
8 min read
HTTP 200 Is a Lie: A 30-Line Schema Canary for Source Drift
0012303 profile

HTTP 200 Is a Lie: A 30-Line Schema Canary for Source Drift

#dataengineering #python #webscraping #api
1
Comments 1
10 min read
Building a Stock Trend Predictor for a Market That Has No API
mishansavy profile

Building a Stock Trend Predictor for a Market That Has No API

#showdev #machinelearning #python #webscraping
Comments 2
6 min read
I Tested Every Web Scraping Tool Against Lazada — Here's What Actually Works (May 2026)
mariatanbobo profile

I Tested Every Web Scraping Tool Against Lazada — Here's What Actually Works (May 2026)

#webscraping #python #ai #devops
Comments
7 min read
I built a competitor pricing monitor in 3 days, here's how it actually works
erramix01 profile

I built a competitor pricing monitor in 3 days, here's how it actually works

#showdev #automation #nextjs #webscraping
Comments
2 min read
Feeding Raw HTML to Your LLM Is a Token Tax. I Measured It on 10 Real Pages — Median 7.4 , and It Hits Every Scheduled Run
0012303 profile

Feeding Raw HTML to Your LLM Is a Token Tax. I Measured It on 10 Real Pages — Median 7.4 , and It Hits Every Scheduled Run

#webscraping #python #ai #dataengineering
2
Comments 2
8 min read
Event-Driven Scraping vs Cron Jobs: What Actually Works at Scale
promptcloud_services profile

Event-Driven Scraping vs Cron Jobs: What Actually Works at Scale

#webscraping
Comments
5 min read
Reliable Web-Connected AI Agents Start at the Fetch Layer
anakin_writers profile

Reliable Web-Connected AI Agents Start at the Fetch Layer

#ai #webscraping #automation #architecture
1
Comments 1
4 min read
Fighting Google Recorder’s export wall
seithx profile

Fighting Google Recorder’s export wall

#node #cli #webscraping #a11y
Comments
2 min read
The Apify Actor Execution Lifecycle: 8 Decision Engines
apify_forge profile

The Apify Actor Execution Lifecycle: 8 Decision Engines

#apify #developertools #webscraping #mcpservers
Comments
18 min read
Monitoring the Chinese Social Media Ecosystem: RedNote, Weibo & Bilibili Data Pipeline
sami_8858131362756585e4f4 profile
Sami

Monitoring the Chinese Social Media Ecosystem: RedNote, Weibo & Bilibili Data Pipeline

#webscraping #china #api #marketing
Comments
5 min read
Track brand mentions across China's top 5 social platforms in one API call — $0.045 per mention
sami_8858131362756585e4f4 profile
Sami

Track brand mentions across China's top 5 social platforms in one API call — $0.045 per mention

#webscraping #apify #china #marketing
Comments
10 min read
Why JSON Schema Validation Isn't Enough for Apify Actors
apify_forge profile

Why JSON Schema Validation Isn't Enough for Apify Actors

#developertools #apify #webscraping #ppepricing
1
Comments
18 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.