DEV Community

Tùng Nguyễn
Tùng Nguyễn

Posted on Edited on

5 Production-Ready Web Scraping & AI Data Extraction REST APIs on RapidAPI Hub (Python, Node.js & cURL)

#webdev #javascript #python #api

Maintaining headless browsers, residential proxy rotation, anti-bot retries, and HTML parsers across dozens of client projects takes time away from building your core product.

To make web data extraction plug-and-play for Python, Node.js, Go, and no-code (Make / Zapier / n8n) workflows, I published 5 production-ready Web Scraping & AI Data Extraction REST APIs on RapidAPI Hub — each with a Free Tier (BASIC $0.00/mo) so you can test immediately in your browser or terminal.

🚀 The 5 Live REST APIs on RapidAPI Hub

1. B2B Website Email, Phone & Social Media Scraper API

Extracts verified emails (mailto: + de-obfuscated text), phone numbers, LinkedIn, Twitter/X, Facebook, Instagram, YouTube, and TikTok profiles across company homepages and /contact or /about pages.

2. Website to Clean Markdown AI, LLM & RAG Converter API

Strips navigation menus, ads, cookie banners, inline scripts, and layout clutter from any webpage and returns structured Markdown with YAML frontmatter, word count, and token estimates for LangChain, LlamaIndex, and OpenAI / Claude RAG pipelines.

3. Shopify Store Product, Price & Contact Scraper API

Extracts complete product catalogs (title, handle, vendor, product_type, price, compare_at_price, discount_pct, in_stock, SKU, images) plus store owner contact details from any Shopify storefront.

4. WooCommerce & WordPress Product, Price & Contact Spy API

Extracts product listings, sale prices, stock status, categories, and merchant contact info from WooCommerce / WordPress e-commerce stores via Store API + ld+json Product schema fallback.

5. Website Sitemap, SEO Audit & Contact Scraper API

Audits on-page technical SEO (<title>, <meta name="description">, canonical URLs, H1–H3 structure, missing image alt attributes, robots.txt, sitemap.xml) while simultaneously extracting lead emails and social links.

💻 Quickstart Code Snippets (Python & Node.js)

Python (requests) — Convert Any URL to LLM-Ready Markdown 

import requests

url = "https://website-to-clean-markdown-ai-llm-rag-converter.p.rapidapi.com/v2/acts/tungnguyen84~website-to-markdown-ai-rag-llm-scraper/run-sync-get-dataset-items"
headers = {
    "x-rapidapi-host": "website-to-clean-markdown-ai-llm-rag-converter.p.rapidapi.com",
    "x-rapidapi-key": "YOUR_RAPIDAPI_KEY",
    "Content-Type": "application/json"
}
payload = {
    "startUrls": [{"url": "https://docs.python.org/3/tutorial/index.html"}]
}

resp = requests.post(url, json=payload, headers=headers, timeout=60)
for item in resp.json():
    print(f"Title: {item.get('title')} ({item.get('estimatedTokens')} tokens)")
    print(item.get("markdown")[:500])
Enter fullscreen mode Exit fullscreen mode

Node.js (fetch) — Scrape B2B Emails & Social Profiles 

const response = await fetch(
  "https://b2b-website-email-phone-social-scraper.p.rapidapi.com/v2/acts/tungnguyen84~b2b-website-email-phone-social-scraper/run-sync-get-dataset-items",
  {
    method: "POST",
    headers: {
      "x-rapidapi-host": "b2b-website-email-phone-social-scraper.p.rapidapi.com",
      "x-rapidapi-key": process.env.RAPIDAPI_KEY,
      "Content-Type": "application/json",
    },
    body: JSON.stringify({
      startUrls: [{ url: "https://apify.com" }],
      maxContactPages: 2,
    }),
  }
);

const leads = await response.json();
console.log(leads);
Enter fullscreen mode Exit fullscreen mode

📦 Want the Full Standalone Source Code & Excel VBA Dashboards?

If you prefer owning the full offline Python CLI tools + 1-click Excel VBA macro suites with zero recurring API fees:

  1. Python B2B Lead Scraper, Email Extractor & Excel VBA Automation Suite Pro ($14.99)
  2. Shopify Competitor Price & Product Spy Pro — Python CLI & Excel Exporter ($12.99)
  3. Ultimate Excel VBA Automation Pack — 10 One-Click Business Macros ($9.99)

Need custom web scraping, API integration, or automated reporting? Message me on Fiverr (@tungnguyen84)!

Top comments (0)