DEV Community

Алексей Спинов
Алексей Спинов

Posted on

The Complete Web Scraping Toolkit: 15 Free Node.js Tools

Here are 15 tools I use daily for web scraping.

Parsing

  1. Cheerio — jQuery-like HTML parsing
  2. xml2js — XML/RSS feeds
  3. csv-parser — CSV files

Browser

  1. Playwright — best browser automation
  2. Puppeteer — Chrome automation

HTTP

  1. fetch — built into Node 18+
  2. got — retries + proxy support

Output

  1. xlsx — create Excel files
  2. json2csv — JSON to CSV
  3. fs — write JSON files

Cloud

  1. Apify SDK — deploy to cloud
  2. node-cron — scheduling

Anti-Detection

  1. User-Agent rotation
  2. Random delays
  3. Proxy agents

All used in my 77 scrapers.

Guides


Need a scraper built? $20. Email: Spinov001@gmail.com | Hire me

Top comments (0)