DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The Waterfall Pattern: A Tiered Strategy for Reliable Data Extraction
withatte profile

The Waterfall Pattern: A Tiered Strategy for Reliable Data Extraction

#webscraping #dataengineering #devops #dataextraction
1
Comments 1
5 min read
From Script to Spreadsheet: Building a Self-Serve Etsy Competitor Tracker
anderecit profile

From Script to Spreadsheet: Building a Self-Serve Etsy Competitor Tracker

#webscraping #devops #python #dataengineering
2
Comments
5 min read
How to Scrape Pinduoduo (拼多多) for Product Data: A Complete Guide
wfgsss profile

How to Scrape Pinduoduo (拼多多) for Product Data: A Complete Guide

#webscraping #ecommerce #python #beginners
Comments
5 min read
I Benchmarked 6 LLMs to Automate My Job Board for $0.35/Month
dalleyne profile

I Benchmarked 6 LLMs to Automate My Job Board for $0.35/Month

#ai #webscraping #llm
5
Comments 2
6 min read
Scraping Chinese E-commerce Sites: Challenges and Solutions
wfgsss profile

Scraping Chinese E-commerce Sites: Challenges and Solutions

#webscraping #python #ecommerce #tutorial
2
Comments 1
6 min read
How I Built an AI-Driven Job Automation Engine: My Hardest Engineering Lessons
drbenzene profile

How I Built an AI-Driven Job Automation Engine: My Hardest Engineering Lessons

#ai #architecture #automation #webscraping
5
Comments 1
3 min read
Calendar Feeds: Where It All Started
alistairjcbrown profile

Calendar Feeds: Where It All Started

#opensource #webdev #javascript #webscraping
2
Comments
4 min read
Your AI Agent Doesn't Need Firecrawl Anymore
nicoeft profile

Your AI Agent Doesn't Need Firecrawl Anymore

#news #webdev #ai #webscraping
Comments 2
6 min read
The End of APIs: Why Vision Agents Are the Future of Scraping
behruamm profile

The End of APIs: Why Vision Agents Are the Future of Scraping

#webscraping #ai #gemini #automation
1
Comments 1
2 min read
Building a 'Data-on-Demand' Microservice: Wrapping Alibaba Scrapers for Internal Tools
withatte profile

Building a 'Data-on-Demand' Microservice: Wrapping Alibaba Scrapers for Internal Tools

#webscraping #scraper #python #dataengineering
2
Comments
5 min read
Automating Catalog Sync: Designing Resilient Scrapers for Dynamic Marketplaces
sommic profile

Automating Catalog Sync: Designing Resilient Scrapers for Dynamic Marketplaces

#webscraping #python #devops #scrapers
2
Comments
5 min read
Super Simple Web Scraping in Java (Jsoup)
deividas-strole profile

Super Simple Web Scraping in Java (Jsoup)

#java #webscraping #intranet #webdev
1
Comments
2 min read
Data Quality at Scale: Validating JSONL Output with Pydantic
sommic profile

Data Quality at Scale: Validating JSONL Output with Pydantic

#webscraping #dataengineering #devops #json
1
Comments 1
4 min read
Building a 'Living' Market Intelligence Dashboard with Python and Streamlit
withatte profile

Building a 'Living' Market Intelligence Dashboard with Python and Streamlit

#webscraping #python #devops #dataengineering
1
Comments 2
5 min read
Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy
sommic profile

Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy

#webscraping #python #dataengineering #devops
Comments 1
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.