DEV Community

Scraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I spent 3 days scraping a site until I tried LLMs for data extraction
__c1b9e06dc90a7e0a676b profile

I spent 3 days scraping a site until I tried LLMs for data extraction

#webdev #python #ai #scraping
Comments
6 min read
My web scraping nightmare ended when I let an LLM read the HTML
__c1b9e06dc90a7e0a676b profile

My web scraping nightmare ended when I let an LLM read the HTML

#webdev #python #ai #scraping
Comments
5 min read
I Thought I Knew Web Scraping — Until I Hit JavaScript
__c1b9e06dc90a7e0a676b profile

I Thought I Knew Web Scraping — Until I Hit JavaScript

#webdev #python #scraping #ai
Comments
4 min read
Why I Gave Up on Regex and Started Using AI for Web Scraping
__c1b9e06dc90a7e0a676b profile

Why I Gave Up on Regex and Started Using AI for Web Scraping

#webdev #python #ai #scraping
Comments
5 min read
I Spent a Weekend Fighting Flaky Scrapers — Here’s What Finally Worked
__c1b9e06dc90a7e0a676b profile

I Spent a Weekend Fighting Flaky Scrapers — Here’s What Finally Worked

#webdev #python #ai #scraping
Comments
5 min read
Advanced Headless Browser Anti-Bot Techniques: TLS & Canvas
alterlab profile

Advanced Headless Browser Anti-Bot Techniques: TLS & Canvas

#antibot #headlessbrowsers #api #scraping
Comments
6 min read
Optimizing Chunking and Data Extraction for Zero-Hallucination RAG
alterlab profile

Optimizing Chunking and Data Extraction for Zero-Hallucination RAG

#rag #llm #datapipelines #scraping
Comments
4 min read
Track YC Demo Day Companies in Real Time (with code)
nexgendata profile

Track YC Demo Day Companies in Real Time (with code)

#ycombinator #demoday #scraping #preseed
Comments
5 min read
Architecture of a Rental Aggregator: Scraping and Normalizing 90+ Sources
caspar_bannink_3728f095d1 profile

Architecture of a Rental Aggregator: Scraping and Normalizing 90+ Sources

#python #scraping #architecture #realestate
Comments
4 min read
Web Scraping is a Contract
ibmendoza profile

Web Scraping is a Contract

#go #web #scraping
4
Comments
8 min read
How I scraped 50k YouTube subtitles in 2 weeks for $7 (and the legal gray zones)
qcrao profile

How I scraped 50k YouTube subtitles in 2 weeks for $7 (and the legal gray zones)

#youtube #scraping #sideprojects #indie
Comments
4 min read
API or browser agent? We picked yes.
whateverneveranywhere profile

API or browser agent? We picked yes.

#browserautomation #ai #scraping #webdev
Comments
7 min read
When web scraping breaks: using AI to extract messy data
__c1b9e06dc90a7e0a676b profile

When web scraping breaks: using AI to extract messy data

#webdev #python #ai #scraping
Comments
5 min read
ISP proxies, AI crawlers, and the slow death of datacenter IPs: 2026 in numbers
ciokan profile

ISP proxies, AI crawlers, and the slow death of datacenter IPs: 2026 in numbers

#webdev #security #scraping #ai
Comments
8 min read
I Tested 15 LLMs for Web Scraping and Built Heuristics Instead
rohith_m_a75381d0f1c3a358 profile
Rohith

I Tested 15 LLMs for Web Scraping and Built Heuristics Instead

#webdev #ai #scraping #javascript
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.