DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to test whether your web extraction API is lying to your agent
zee_builds profile
Zee

How to test whether your web extraction API is lying to your agent

#agents #api #testing #webscraping
Comments
3 min read
How we built a hiring-intent lead finder using Google as the backend (no login, no ban risk)
james_taylor_037c857e0299 profile

How we built a hiring-intent lead finder using Google as the backend (no login, no ban risk)

#webscraping #javascript #api #saas
Comments
4 min read
When an Actor Platform Is Too Much for an LLM Scraping Task
anakin_writers profile
Anakin

When an Actor Platform Is Too Much for an LLM Scraping Task

#llm #webscraping #api #architecture
Comments
4 min read
How to Know If You Actually Need Mobile Proxies (Without Buying Any)
marketing_guider profile

How to Know If You Actually Need Mobile Proxies (Without Buying Any)

#webscraping #typescript #opensource #javascript
1
Comments
8 min read
Scraping Korea's biggest stores: the hidden JSON APIs behind Olive Young, Musinsa & Naver
parkseokjune profile

Scraping Korea's biggest stores: the hidden JSON APIs behind Olive Young, Musinsa & Naver

#api #javascript #webscraping #ecommerce
2
Comments
4 min read
I Built a $29/Month API That Turns Any Website Into Structured JSON (No AI Black Box)
sergio_morales_c705507bcd profile

I Built a $29/Month API That Turns Any Website Into Structured JSON (No AI Black Box)

#showdev #api #webscraping #javascript
Comments
2 min read
Parsing robots.txt for 10 AI Crawlers: Wildcards, Partial Blocks, Line Numbers
geology_ai profile

Parsing robots.txt for 10 AI Crawlers: Wildcards, Partial Blocks, Line Numbers

#ai #llm #webdev #webscraping
Comments
5 min read
How we built a Reddit comment-tree scraper that returns upvote scores — through a residential proxy
james_taylor_037c857e0299 profile

How we built a Reddit comment-tree scraper that returns upvote scores — through a residential proxy

#webscraping #javascript #reddit #apify
Comments
6 min read
How to read a Polymarket Up/Down outcome (and the Price To Beat) before the oracle settles
bluewhale-quant-lab profile

How to read a Polymarket Up/Down outcome (and the Price To Beat) before the oracle settles

#polymarket #python #webscraping #crypto
Comments
4 min read
Cloudflare y OpenAI: un piloto para que la IA deje de rastrear al pedo
gustavo_theler_f6dc645659 profile

Cloudflare y OpenAI: un piloto para que la IA deje de rastrear al pedo

#news #ai #openai #webscraping
Comments
5 min read
YouTube Transcript Scraper: bulk-download captions for RAG, AI, and show notes
devil_scrapes profile

YouTube Transcript Scraper: bulk-download captions for RAG, AI, and show notes

#webscraping #python #apify #ai
Comments
7 min read
Your Scraper Returns 200 OK and Lies. Here's How to Catch It.
ismail_haddou profile

Your Scraper Returns 200 OK and Lies. Here's How to Catch It.

#ai #cybersecurity #dataengineering #webscraping
Comments
5 min read
Why your RAG accuracy problem is probably stale data (2026)
promptcloud_services profile

Why your RAG accuracy problem is probably stale data (2026)

#webscraping #ai #automation
Comments 3
6 min read
Detecting Q&A Patterns and Heading Trees in Raw HTML
geology_ai profile

Detecting Q&A Patterns and Heading Trees in Raw HTML

#html #machinelearning #nlp #webscraping
1
Comments 1
6 min read
When scraping orchestration is the wrong abstraction for LLM workflows
anakin_writers profile
Anakin

When scraping orchestration is the wrong abstraction for LLM workflows

#webscraping #llm #api #architecture
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.