DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Choosing Between Scraping APIs, Browser Sessions, and Self-Managed Playwright
anakin_writers profile

Choosing Between Scraping APIs, Browser Sessions, and Self-Managed Playwright

#playwright #webscraping #ai #architecture
Comments
5 min read
Building a Resilient Meta Ads Scraper: What Breaks (and What I Learned Fixing It)
milton_ngeno_c9aabd639087 profile

Building a Resilient Meta Ads Scraper: What Breaks (and What I Learned Fixing It)

#api #data #softwareengineering #webscraping
Comments
4 min read
Google Trends will 429 you into the ground — here's how I got past it
votiakov profile

Google Trends will 429 you into the ground — here's how I got past it

#webscraping #python #javascript #seo
3
Comments 3
5 min read
Extracting and Organizing Content from Older Websites: A Solution for Structured Documentation Including Mouse-Over Images
denlava profile

Extracting and Organizing Content from Older Websites: A Solution for Structured Documentation Including Mouse-Over Images

#webscraping #legacywebsites #browserautomation #dommanipulation
Comments
7 min read
Async Scraping Jobs Are Usually a Better Fit for RAG Ingestion Than Blocking Requests
anakin_writers profile

Async Scraping Jobs Are Usually a Better Fit for RAG Ingestion Than Blocking Requests

#ai #rag #webscraping #architecture
Comments
4 min read
Building an Instagram-powered app without managing scraping infrastructure
fun_withpython_a9e86984d profile

Building an Instagram-powered app without managing scraping infrastructure

#python #api #webscraping
Comments
2 min read
Stop parsing HTML to get product data — the JSON is already in the page
votiakov profile

Stop parsing HTML to get product data — the JSON is already in the page

#webscraping #ecommerce #javascript #api
2
Comments 2
4 min read
How to Scrape Google Maps for Local Business Leads (with Emails) - No API Key
fruityp profile

How to Scrape Google Maps for Local Business Leads (with Emails) - No API Key

#api #webscraping #python #automation
Comments
3 min read
Reading Google Play and App Store reviews straight from their JSON, no browser
votiakov profile

Reading Google Play and App Store reviews straight from their JSON, no browser

#webscraping #javascript #api #node
Comments 2
5 min read
Most company job boards are just a public JSON API you can GET
votiakov profile

Most company job boards are just a public JSON API you can GET

#webscraping #api #javascript #jobs
1
Comments
5 min read
Hello Dev.to 👋 — A Developer Joining the Community
orange-big profile

Hello Dev.to 👋 — A Developer Joining the Community

#showdev #python #sideprojects #webscraping
Comments
1 min read
Why Reddit Blocked Unauthenticated JSON in 2026 (and How to Still Get Reddit Data)
tonywangca profile

Why Reddit Blocked Unauthenticated JSON in 2026 (and How to Still Get Reddit Data)

#webscraping #reddit #ai #api
Comments
8 min read
Building Reliable Web Access for AI Agents: Search, Crawl, Markdown, and Screenshots
kun_shen_eedb57cc827955f5 profile

Building Reliable Web Access for AI Agents: Search, Crawl, Markdown, and Screenshots

#webscraping
Comments
3 min read
Replacing Fragile CSS Selectors with LLM-Powered Zero-Shot JSON Extraction
alterlab profile

Replacing Fragile CSS Selectors with LLM-Powered Zero-Shot JSON Extraction

#webscraping #aiagents #llm #python
Comments
8 min read
Querying Germany's Company Register via API: Clean JSON and the new eGbR
pat198707 profile

Querying Germany's Company Register via API: Clean JSON and the new eGbR

#api #data #dataengineering #webscraping
Comments
1 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.