DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The Waterfall Pattern: A Tiered Strategy for Reliable Data Extraction
withatte profile

The Waterfall Pattern: A Tiered Strategy for Reliable Data Extraction

#webscraping #dataengineering #devops #dataextraction
Comments 1
5 min read
How to Build a China Wholesale Price Tracker with DHgate and Yiwugo Data
wfgsss profile

How to Build a China Wholesale Price Tracker with DHgate and Yiwugo Data

#webscraping #ecommerce #python #productivity
Comments
7 min read
How to Scrape Pinduoduo (拼多多) for Product Data: A Complete Guide
wfgsss profile

How to Scrape Pinduoduo (拼多多) for Product Data: A Complete Guide

#webscraping #ecommerce #python #beginners
Comments
5 min read
Made-in-China.com vs DHgate vs Yiwugo: Which Platform to Scrape for Wholesale Product Data
wfgsss profile

Made-in-China.com vs DHgate vs Yiwugo: Which Platform to Scrape for Wholesale Product Data

#webscraping #ecommerce #python #wholesale
Comments
3 min read
I Benchmarked 6 LLMs to Automate My Job Board for $0.35/Month
dalleyne profile

I Benchmarked 6 LLMs to Automate My Job Board for $0.35/Month

#ai #webscraping #llm
5
Comments 2
6 min read
How I Built an AI-Driven Job Automation Engine: My Hardest Engineering Lessons
drbenzene profile

How I Built an AI-Driven Job Automation Engine: My Hardest Engineering Lessons

#ai #architecture #automation #webscraping
5
Comments 1
3 min read
Calendar Feeds: Where It All Started
alistairjcbrown profile

Calendar Feeds: Where It All Started

#opensource #webdev #javascript #webscraping
2
Comments
4 min read
Your AI Agent Doesn't Need Firecrawl Anymore
nicoeft profile

Your AI Agent Doesn't Need Firecrawl Anymore

#news #webdev #ai #webscraping
Comments 1
6 min read
How to Generate a Google Shopping Feed from Any Website Using Python
withatte profile

How to Generate a Google Shopping Feed from Any Website Using Python

#webscraping #datascraping #googleshopping #python
1
Comments 1
5 min read
The End of APIs: Why Vision Agents Are the Future of Scraping
behruamm profile

The End of APIs: Why Vision Agents Are the Future of Scraping

#webscraping #ai #gemini #automation
1
Comments 1
2 min read
Data Quality at Scale: Validating JSONL Output with Pydantic
sommic profile

Data Quality at Scale: Validating JSONL Output with Pydantic

#webscraping #dataengineering #devops #json
1
Comments 1
4 min read
High-Frequency eBay Scraping: Sync Prices and Stock Without Getting Banned
sommic profile

High-Frequency eBay Scraping: Sync Prices and Stock Without Getting Banned

#webscraping #datascraping #proxies #ebayscraping
Comments 3
5 min read
Building a 'Living' Market Intelligence Dashboard with Python and Streamlit
withatte profile

Building a 'Living' Market Intelligence Dashboard with Python and Streamlit

#webscraping #python #devops #dataengineering
1
Comments 2
5 min read
Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy
sommic profile

Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy

#webscraping #python #dataengineering #devops
Comments 1
5 min read
App Store Scraper: Find Untranslated iOS Apps to Clone for Your Market (2026)
kazkn profile

App Store Scraper: Find Untranslated iOS Apps to Clone for Your Market (2026)

#webscraping #apify #ios #tutorial
Comments 1
14 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.