DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Choosing Between Scraping APIs, Browser Sessions, and Self-Managed Playwright
anakin_writers profile

Choosing Between Scraping APIs, Browser Sessions, and Self-Managed Playwright

#playwright #webscraping #ai #architecture
Comments
5 min read
EffatĂ : Chronicle of a Human-AI Collaboration for a Different Kind of Search Engine by DeepSeek, AI assistant
fugace_o_e3756906fe8f8e4 profile

EffatĂ : Chronicle of a Human-AI Collaboration for a Different Kind of Search Engine by DeepSeek, AI assistant

#ai #sideprojects #webdev #webscraping
1
Comments
7 min read
Building a Resilient Meta Ads Scraper: What Breaks (and What I Learned Fixing It)
milton_ngeno_c9aabd639087 profile

Building a Resilient Meta Ads Scraper: What Breaks (and What I Learned Fixing It)

#api #data #softwareengineering #webscraping
Comments
4 min read
Google Trends will 429 you into the ground — here's how I got past it
votiakov profile

Google Trends will 429 you into the ground — here's how I got past it

#webscraping #python #javascript #seo
4
Comments 3
5 min read
What breaks when you scrape Steam Community Market at scale
0xgollum profile

What breaks when you scrape Steam Community Market at scale

#python #webscraping #apify #buildinpublic
1
Comments 6
2 min read
Extracting and Organizing Content from Older Websites: A Solution for Structured Documentation Including Mouse-Over Images
denlava profile

Extracting and Organizing Content from Older Websites: A Solution for Structured Documentation Including Mouse-Over Images

#webscraping #legacywebsites #browserautomation #dommanipulation
Comments
7 min read
Async Scraping Jobs Are Usually a Better Fit for RAG Ingestion Than Blocking Requests
anakin_writers profile

Async Scraping Jobs Are Usually a Better Fit for RAG Ingestion Than Blocking Requests

#ai #rag #webscraping #architecture
Comments
4 min read
I scraped live betting odds from 9 countries and never once hit a real anti-bot wall
0xgollum profile

I scraped live betting odds from 9 countries and never once hit a real anti-bot wall

#webscraping #python #api #buildinpublic
Comments
3 min read
Building an Instagram-powered app without managing scraping infrastructure
fun_withpython_a9e86984d profile

Building an Instagram-powered app without managing scraping infrastructure

#python #api #webscraping
Comments
2 min read
Stop parsing HTML to get product data — the JSON is already in the page
votiakov profile

Stop parsing HTML to get product data — the JSON is already in the page

#webscraping #ecommerce #javascript #api
2
Comments 2
4 min read
Reading Google Play and App Store reviews straight from their JSON, no browser
votiakov profile

Reading Google Play and App Store reviews straight from their JSON, no browser

#webscraping #javascript #api #node
Comments 2
5 min read
Hello Dev.to 👋 — A Developer Joining the Community
orange-big profile

Hello Dev.to 👋 — A Developer Joining the Community

#showdev #python #sideprojects #webscraping
Comments
1 min read
Most company job boards are just a public JSON API you can GET
votiakov profile

Most company job boards are just a public JSON API you can GET

#webscraping #api #javascript #jobs
3
Comments
5 min read
Why Reddit Blocked Unauthenticated JSON in 2026 (and How to Still Get Reddit Data)
tonywangca profile

Why Reddit Blocked Unauthenticated JSON in 2026 (and How to Still Get Reddit Data)

#webscraping #reddit #ai #api
Comments
8 min read
Building Reliable Web Access for AI Agents: Search, Crawl, Markdown, and Screenshots
kun_shen_eedb57cc827955f5 profile

Building Reliable Web Access for AI Agents: Search, Crawl, Markdown, and Screenshots

#webscraping
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.