DEV Community

wfgsss
wfgsss

Posted on • Edited on

How to Scrape Yiwugo.com for Wholesale Product Data

#webscraping #beginners #tutorial #api

How to Scrape Yiwugo.com for Wholesale Product Data

What is Yiwugo?

Yiwugo.com (δΉ‰δΉŒθ΄­) is the official e-commerce platform of Yiwu International Trade Market, the world's largest wholesale market for small commodities. Located in Yiwu, China, this market connects millions of buyers with thousands of suppliers offering everything from jewelry and accessories to home goods and electronics.

For businesses looking to source products from China, Yiwugo is a goldmine of data. However, manually collecting product information, prices, and supplier details is time-consuming and inefficient. That's where automated scraping comes in.

Introducing the Yiwugo Scraper

The Yiwugo Scraper is a powerful tool built on the Apify platform that automates data extraction from Yiwugo.com. It supports two main scraping modes:

  1. Search Mode: Extract products based on keyword searches
  2. Category Mode: Scrape entire product categories

Key Features

  • Extract product titles, prices, and images
  • Get supplier information and contact details
  • Support for both Chinese and English interfaces
  • Configurable result limits
  • Export data in JSON, CSV, or Excel formats
  • No coding required for basic usage

How to Use the Scraper

Method 1: Search Mode

Perfect for finding specific products by keyword.

Example Input:

{
  "mode": "search",
  "keyword": "bluetooth speaker",
  "maxItems": 50
}
Enter fullscreen mode Exit fullscreen mode

This will search for "bluetooth speaker" and return up to 50 product listings with details like:

  • Product name and description
  • Price (wholesale and retail)
  • Minimum order quantity
  • Supplier name and location
  • Product images
  • Direct product URL

Method 2: Category Mode

Ideal for scraping entire product categories.

Example Input:

{
  "mode": "category",
  "categoryUrl": "https://www.yiwugo.com/category/123456",
  "maxItems": 100
}
Enter fullscreen mode Exit fullscreen mode

Using the API

For developers who want to integrate Yiwugo data into their applications, here's a quick example using the Apify API:

const ApifyClient = require('apify-client');

const client = new ApifyClient({
    token: 'YOUR_APIFY_TOKEN',
});

const input = {
    mode: "search",
    keyword: "phone accessories",
    maxItems: 100
};

const run = await client.actor("jungle_intertwining/yiwugo-scraper").call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();

console.log(`Scraped ${items.length} products`);
items.forEach((item) => {
    console.log(`${item.title} - ${item.price}`);
});
Enter fullscreen mode Exit fullscreen mode

Python Example:

from apify_client import ApifyClient

client = ApifyClient('YOUR_APIFY_TOKEN')

run_input = {
    "mode": "search",
    "keyword": "jewelry",
    "maxItems": 50
}

run = client.actor("jungle_intertwining/yiwugo-scraper").call(run_input=run_input)

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(f"{item['title']} - {item['price']}")
Enter fullscreen mode Exit fullscreen mode

Use Cases

1. Market Research

Analyze pricing trends and product availability across different categories.

2. Competitor Analysis

Monitor what products competitors are sourcing and at what prices.

3. Supplier Discovery

Find reliable suppliers for specific product categories.

4. Price Monitoring

Track price changes over time to optimize purchasing decisions.

5. Product Database

Build a comprehensive database of wholesale products for your e-commerce platform.

Best Practices

  1. Start Small: Test with a low maxItems value first to understand the data cture
  2. Respect Rate Limits: Don't scrape too aggressively to avoid being blocked
  3. Use Specific Keywords: More specific searches yield better results
  4. Schedule Regular Runs: Set up scheduled runs to keep your data fresh
  5. Clean Your Data: Post-process the scraped data to remove duplicates and normalize formats

Pricing

The scraper runs on Apify's platform, which offers:

  • Free tier with $5 monthly credit
  • Pay-as-you-go pricing based on compute usage
  • Typical cost: $0.25-$1 per 1000 products scraped

Getting Started

Ready to start scraping Yiwugo data?

πŸ‘‰ Try the Yiwugo Scraper on Apify

No credit card required for the free tier. You can start extracting wholesale product data in minutes!

πŸ“š Related: Running into anti-bot walls or encoding issues? Check out Scraping Chinese E-commerce Sites: Challenges and Solutions for proven workarounds.

Keywords: yiwugo scraper, yiwu market data, china wholesale scraper, yiwugo api, wholesale product scraper, china sourcing tool, yiwu international trade market

Tags: #webscraping #ecommerce #wholesale #china #datamining #apify #yiwugo

πŸ“¦ Also check out: DHgate Scraper β€” Extract DHgate product data for dropshipping research.

πŸ“š More on wholesale data:

Top comments (0)