Here are 15 tools I use daily for web scraping.
Parsing
- Cheerio — jQuery-like HTML parsing
- xml2js — XML/RSS feeds
- csv-parser — CSV files
Browser
- Playwright — best browser automation
- Puppeteer — Chrome automation
HTTP
- fetch — built into Node 18+
- got — retries + proxy support
Output
- xlsx — create Excel files
- json2csv — JSON to CSV
- fs — write JSON files
Cloud
- Apify SDK — deploy to cloud
- node-cron — scheduling
Anti-Detection
- User-Agent rotation
- Random delays
- Proxy agents
All used in my 77 scrapers.
Guides
Need a scraper built? $20. Email: Spinov001@gmail.com | Hire me
Top comments (0)