DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Stop Manually Copying YouTube Captions: Automate Your Video Data Pipeline

Stop Manually Copying YouTube Captions: Automate Your Video Data Pipeline

Comments
2 min read
How to Build a China Supplier Database with Made-in-China.com and Yiwugo Data

How to Build a China Supplier Database with Made-in-China.com and Yiwugo Data

Comments
6 min read
How to Generate a Google Shopping Feed from Any E-commerce Site Using Python

How to Generate a Google Shopping Feed from Any E-commerce Site Using Python

Comments
5 min read
How to Find OEM Manufacturers on Made-in-China.com Using Scraping Data

How to Find OEM Manufacturers on Made-in-China.com Using Scraping Data

Comments
6 min read
How to scrape TikTok search results: A complete guide for 2026

How to scrape TikTok search results: A complete guide for 2026

5
Comments
12 min read
The Complete Guide to China Wholesale Data Scraping: Tools, Platforms, and Best Practices

The Complete Guide to China Wholesale Data Scraping: Tools, Platforms, and Best Practices

Comments
8 min read
Build a Bluesky Analytics Dashboard with Python (Step-by-Step)

Build a Bluesky Analytics Dashboard with Python (Step-by-Step)

1
Comments
5 min read
Automating Market Research on Dermstore: Scrape Categories and Monitor Inventory Trends

Automating Market Research on Dermstore: Scrape Categories and Monitor Inventory Trends

2
Comments
5 min read
Building an Automated Prospect Research Pipeline with Cron Jobs

Building an Automated Prospect Research Pipeline with Cron Jobs

1
Comments
3 min read
Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy

Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy

Comments 1
5 min read
From Script to Spreadsheet: Building a Self-Serve Etsy Competitor Tracker

From Script to Spreadsheet: Building a Self-Serve Etsy Competitor Tracker

2
Comments
5 min read
I Built 34 Web Scrapers — Here's What I Learned About Anti-Bot Detection

I Built 34 Web Scrapers — Here's What I Learned About Anti-Bot Detection

3
Comments 1
4 min read
Web Scraping Infrastructure Guide: APIs vs Proxies vs Headless Browsers (2026)

Web Scraping Infrastructure Guide: APIs vs Proxies vs Headless Browsers (2026)

Comments 1
7 min read
How to Scrape Pinduoduo (拼多多) for Product Data: A Complete Guide

How to Scrape Pinduoduo (拼多多) for Product Data: A Complete Guide

Comments
5 min read
Production-Grade Costco Scraping: Error Budgets, Retries, and Pipelines

Production-Grade Costco Scraping: Error Budgets, Retries, and Pipelines

1
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.