DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Booking.com Search Rows Hide 9–16% of the Price in a Field Labelled 21, 22 and 23
matveyg profile

Booking.com Search Rows Hide 9–16% of the Price in a Field Labelled 21, 22 and 23

#webscraping #api #python #data
Comments
6 min read
Craigslist's JSON-LD has no ID field — we join 290 of 325 listings by title alone
devil_scrapes profile

Craigslist's JSON-LD has no ID field — we join 290 of 325 listings by title alone

#webscraping #python #api #datascience
Comments
5 min read
BBB.org's business data isn't in the HTML — it's in an analytics script tag
devil_scrapes profile

BBB.org's business data isn't in the HTML — it's in an analytics script tag

#webscraping #python #api #opendata
Comments
5 min read
Is your ai agent ready for the hostile web? Join Zyte 2nd virtual community meet-up to learn
iayanpahwa profile

Is your ai agent ready for the hostile web? Join Zyte 2nd virtual community meet-up to learn

#ai #security #webscraping #agents
1
Comments
4 min read
I Had an AI Agent Scrape Google Maps Instead of Writing a Scraper. Here's What It Cost.
orange_k profile

I Had an AI Agent Scrape Google Maps Instead of Writing a Scraper. Here's What It Cost.

#ai #webscraping #playwright #claude
Comments 1
8 min read
Proxy Pool Health Monitoring: Turning "It Works" into Metrics You Can Act On
socks5ip profile

Proxy Pool Health Monitoring: Turning "It Works" into Metrics You Can Act On

#python #webscraping #devops #tutorial
Comments
5 min read
Ten Mercado Libre Results, Four Kinds of Link — and Only Two Carry the Product ID
matveyg profile

Ten Mercado Libre Results, Four Kinds of Link — and Only Two Carry the Product ID

#webscraping #javascript #api #data
Comments
6 min read
What it actually takes to read a Xiaohongshu post from a server
programming_withjackche profile

What it actually takes to read a Xiaohongshu post from a server

#webscraping #python #ai
Comments 1
4 min read
Xiaohongshu share links have two domains, and one of them will fail silently
programming_withjackche profile

Xiaohongshu share links have two domains, and one of them will fail silently

#webscraping #ai #python
Comments 1
4 min read
Three small API-backed actors I've shipped recently (Docker Hub, lead extraction, SEC Form 4)
timmkal01 profile

Three small API-backed actors I've shipped recently (Docker Hub, lead extraction, SEC Form 4)

#showdev #api #webscraping #opensource
1
Comments 1
2 min read
The 429 Playbook: Handling Rate Limits Before Your IP Gets Banned
yuhehe profile

The 429 Playbook: Handling Rate Limits Before Your IP Gets Banned

#api #backend #performance #webscraping
2
Comments 11
2 min read
Google Maps results to emails: add contacts to a Maps Scraper dataset, one row per place
hiver profile

Google Maps results to emails: add contacts to a Maps Scraper dataset, one row per place

#webscraping #python #leadgeneration #googlemaps
2
Comments 1
4 min read
Rotating Proxies with Python Requests: A Copy-Paste Starter Kit
squid-proxies profile

Rotating Proxies with Python Requests: A Copy-Paste Starter Kit

#python #webscraping #tutorial #requests
Comments
4 min read
A finished scraper sat on a git branch for 19 days. Nothing noticed.
devil_scrapes profile

A finished scraper sat on a git branch for 19 days. Nothing noticed.

#webscraping #python #git #devops
Comments
5 min read
Residential Proxies Made My Lazada Scraper Worse: the Gate Reads the Handshake, Not the IP
matveyg profile

Residential Proxies Made My Lazada Scraper Worse: the Gate Reads the Handshake, Not the IP

#webscraping #javascript #api #data
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.