DEV Community

Sami
Sami

Posted on

Monitoring the Chinese Social Media Ecosystem: RedNote, Weibo & Bilibili Data Pipeline

If you are doing market research, brand monitoring, competitive intelligence, or academic research on China, no single platform tells the whole story. Chinese internet users spread across specialized platforms the way Western users split between Twitter, Instagram, YouTube, and Reddit — but the Chinese platforms are larger, more fragmented, and harder to access from outside the country.

This article maps the three most important Chinese social platforms for data collection, explains what each one covers, and shows how to build a unified monitoring pipeline using three Apify Actors that share a common architecture: no browser, no proxy, no API keys.


The Three Pillars of Chinese Social Media Intelligence

1. RedNote / Xiaohongshu (小红书) — Social Commerce & Lifestyle

What it is: China's Instagram meets Pinterest. A social commerce platform where users share product reviews, lifestyle content, travel diaries, and beauty routines. Known for its influence on Chinese consumer purchasing decisions.

User base: 200M+ monthly active users

Why it matters for research:

  • Product sentiment and unfiltered consumer reviews
  • Trend detection in beauty, fashion, food, travel, and lifestyle
  • Influencer (KOL/KOC) discovery for Chinese market campaigns
  • Brand perception monitoring among Chinese consumers

Actor: zhorex/rednote-scraper

Modes: Search posts, user profiles, post comments, trending topics


2. Weibo (微博) — Microblogging & Public Opinion

What it is: China's Twitter. The platform where Chinese public opinion forms in real-time. Breaking news, celebrity drama, government communications, and brand PR all happen on Weibo.

User base: 580M+ monthly active users

Why it matters for research:

  • Real-time trending topics with heat scores and categories
  • Public opinion tracking on policy, brands, and international events
  • Celebrity and KOL influence measurement
  • Crisis monitoring and brand sentiment during PR events

Actor: zhorex/weibo-scraper

Modes: Hot search/trending, post comments, keyword search, user posts

Auth note: Trending topics and post comments work without login. Search and user posts require a Weibo SUB cookie (easily obtained from a browser session).


3. Bilibili (哔哩哔哩) — Video & Creator Analytics

What it is: China's YouTube, with a strong focus on anime, gaming, tech education, and Gen Z culture. Known for its unique danmaku (弹幕) system — scrolling comments that overlay the video in real-time.

User base: 300M+ monthly active users

Why it matters for research:

  • Creator analytics with Bilibili-specific metrics (danmaku, coins, favorites)
  • Gaming and anime industry monitoring
  • Chinese Gen Z content trends and preferences
  • Tech and education content analysis

Actor: zhorex/bilibili-scraper

Modes: Search videos, video details, video comments, user/creator videos, popular/trending


Platform Comparison

Dimension RedNote Weibo Bilibili
Platform type Social commerce Microblogging Video
Primary audience Women 18-35, consumers All demographics Gen Z, gamers, students
Content format Photos + short text Short posts (tweets) Long-form video
Best for Product sentiment, lifestyle trends Breaking news, public opinion Creator analytics, youth culture
Unique data Purchase intent, product reviews Hot search rankings, heat scores Danmaku counts, coin tipping
Auth required No Partial (trending: no, search: yes) No
MAU 200M+ 580M+ 300M+
Actor rednote-scraper weibo-scraper bilibili-scraper

Building a Unified Pipeline

All three actors share common design principles:

  • Pure HTTP — no browser needed, minimal compute
  • 256MB RAM — cheap to run
  • Pay-per-event — $5 per 1,000 items for all three
  • JSON/CSV/Excel output — same export formats
  • Apify integrations — Google Sheets, S3, webhooks, Zapier, Make, n8n

Example: Daily China Brand Monitor

Here is a practical pipeline architecture using all three actors:

Step 1: Schedule daily runs for each actor via Apify Schedules.

RedNote — search for your brand name in Chinese:

{
  "mode": "search",
  "searchQuery": "你的品牌名",
  "maxResults": 50
}
Enter fullscreen mode Exit fullscreen mode

Weibo — monitor trending mentions:

{
  "mode": "hot_search",
  "maxResults": 50
}
Enter fullscreen mode Exit fullscreen mode

Bilibili — track video mentions:

{
  "mode": "search",
  "searchQuery": "你的品牌名",
  "maxResults": 50
}
Enter fullscreen mode Exit fullscreen mode

Step 2: Use Apify webhooks to push results to your data warehouse (S3 → Snowflake/BigQuery) or directly to Google Sheets for a lightweight dashboard.

Step 3: Set up alerting — use Zapier or Make to send Slack notifications when specific keywords appear in trending topics or when engagement spikes on brand-related content.


Use Case Examples

Brand Entering the Chinese Market

A Western consumer brand preparing to launch in China runs all three actors to understand:

  • RedNote: What do Chinese consumers say about the product category? What do they value? Which competitor products are reviewed positively?
  • Weibo: Is the brand already discussed in Chinese media? What is the general sentiment?
  • Bilibili: Are there video reviews or unboxing content for the brand or competitors?

Academic Research on Chinese Digital Culture

A researcher studying Chinese Gen Z media consumption uses:

  • Bilibili: Trending video content, danmaku engagement patterns, creator growth trajectories
  • Weibo: Public discourse topics, hashtag trends over time
  • RedNote: Lifestyle and consumption trends, product preference signals

PR Crisis Monitoring

A multinational company monitors all three platforms for brand mentions after a negative news cycle:

  • Weibo: Real-time trending topics and comment sentiment (the fastest-moving platform)
  • RedNote: Consumer reaction and product boycott signals
  • Bilibili: Video commentary and creator opinion pieces

Technical Architecture

All three actors share:

Feature Detail
Runtime Pure HTTP (no Playwright/Puppeteer)
Memory 256MB RAM
Proxy Not required
API keys Not required
Output JSON, CSV, XLSX, JSONL
Rate limiting Built-in backoff and retry
Language Content in original Simplified Chinese
Translation Pipe through Google Translate, DeepL, or Claude for English

Pricing

All three actors use the same pricing model:

Volume Cost per actor
1,000 items $5
10,000 items $50
100,000 items $500

Running all three actors daily with 50 items each = 150 items/day × 30 days = 4,500 items/month ≈ $22.50/month for comprehensive daily China monitoring across three platforms.

Apify's free plan includes $5 of monthly credits — enough to test all three actors.


FAQ

Do I need a VPN to scrape Chinese platforms?
No. All three actors use public HTTP endpoints that are globally accessible. No VPN or proxy is required.

Is the data in Chinese?
Yes. All content is returned in the original Simplified Chinese. For English translations, pipe the output through a translation service.

Can I combine data from all three actors?
Yes. All three output JSON with similar schemas. Use Apify's dataset API or export to a shared warehouse for unified analysis.

Is scraping Chinese social media legal?
These actors only access publicly available data through public web endpoints. No authentication is bypassed and no private data is accessed. Always review your local laws and each platform's terms of service.


Get Started

Start with one platform, validate the data quality, then expand to all three for comprehensive Chinese social media intelligence.

Built by Zhorex — the only developer on Apify specializing in Chinese platform intelligence.

Top comments (0)