DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
AI-Powered Web Scraper
zahidkhan-xen profile

AI-Powered Web Scraper

#showdev #ai #automation #webscraping
Comments
4 min read
I scraped every **Show HN** post from May 2025 to May 2026 that crossed **200 points** and ran a quick analysis. There were 334 of them. Here is what landed.
sab0tajue profile

I scraped every **Show HN** post from May 2025 to May 2026 that crossed **200 points** and ran a quick analysis. There were 334 of them. Here is what landed.

#analytics #data #sideprojects #webscraping
Comments
3 min read
Scraping 1000 Pages in 10 Seconds: Python Async HTTP Guide
armorbreak profile

Scraping 1000 Pages in 10 Seconds: Python Async HTTP Guide

#performance #python #tutorial #webscraping
1
Comments
5 min read
Scraping Dynamic Web Pages Without Selectors Using AI Vision (TypeScript/JavaScript Tutorial)
parastejpal987cmyk profile

Scraping Dynamic Web Pages Without Selectors Using AI Vision (TypeScript/JavaScript Tutorial)

#webscraping #javascript #ai #node
1
Comments
2 min read
Why Web Agents Fail on Protected Sites — And How to Fix It at the Infrastructure Level
tinyfishie profile

Why Web Agents Fail on Protected Sites — And How to Fix It at the Infrastructure Level

#agents #infrastructure #security #webscraping
Comments
7 min read
Bypassing Scraper Latency: Building a Real-Time Economic Indicator (REI) Tracker with Python
kazutaka_kobayashi_45117a profile

Bypassing Scraper Latency: Building a Real-Time Economic Indicator (REI) Tracker with Python

#python #webscraping #dataengineering #economics
Comments
4 min read
FULL SSRF + EXFILTRACION EN CRAWLEE
arturo0x90 profile

FULL SSRF + EXFILTRACION EN CRAWLEE

#cybersecurity #security #spanish #webscraping
Comments
12 min read
What I learned scraping Bulk URL Status Checker: schema, gotchas and the tooling that worked
can_ylmaz_da7b70586976b3 profile

What I learned scraping Bulk URL Status Checker: schema, gotchas and the tooling that worked

#webscraping #apify #data #tutorial
Comments
3 min read
Sample dataset analysis: a 100-row snapshot of Bazaraki
can_ylmaz_da7b70586976b3 profile

Sample dataset analysis: a 100-row snapshot of Bazaraki

#webscraping #apify #realestate #dataengineering
Comments
3 min read
Comparing approaches to extracting Hacker News Who Is Hiring data
can_ylmaz_da7b70586976b3 profile

Comparing approaches to extracting Hacker News Who Is Hiring data

#webscraping #apify #jobs #dataengineering
Comments
3 min read
Building a Letterboxd Film & Review data pipeline: from raw scrape to first insight
can_ylmaz_da7b70586976b3 profile

Building a Letterboxd Film & Review data pipeline: from raw scrape to first insight

#webscraping #apify #socialmedia #dataengineering
Comments
3 min read
What I learned scraping ClinicalTrials.gov: schema, gotchas and the tooling that worked
can_ylmaz_da7b70586976b3 profile

What I learned scraping ClinicalTrials.gov: schema, gotchas and the tooling that worked

#webscraping #apify #opendata #tutorial
Comments
3 min read
How I Built a Real Chinese Product Review Aggregator (and Why English Reviews Are Broken)
wuledan profile

How I Built a Real Chinese Product Review Aggregator (and Why English Reviews Are Broken)

#showdev #sideprojects #webdev #webscraping
Comments
1 min read
Feeding Raw HTML to Your LLM Is a Token Tax. I Measured It on 10 Real Pages — Median 7.4 , and It Hits Every Scheduled Run
0012303 profile

Feeding Raw HTML to Your LLM Is a Token Tax. I Measured It on 10 Real Pages — Median 7.4 , and It Hits Every Scheduled Run

#webscraping #python #ai #dataengineering
2
Comments 1
8 min read
What I learned scraping Website Contact: schema, gotchas and the tooling that worked
can_ylmaz_da7b70586976b3 profile

What I learned scraping Website Contact: schema, gotchas and the tooling that worked

#webscraping #apify #leadgen #tutorial
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.