I've compiled a list of 60+ free web scraping tools that cover every major data source — social media, e-commerce, news, SEO, and more. All tools run on Apify with a free tier.
Social Media Scrapers
| Tool |
What It Extracts |
Auth Needed? |
| Bluesky Scraper |
Posts, profiles, followers — AT Protocol API |
No |
| Bluesky Feed Monitor |
Real-time feed engagement analytics |
No |
| Bluesky Hashtag Tracker |
Trending hashtags and post counts |
No |
| Bluesky Profile Batch |
Bulk profile lookup |
No |
| Reddit Scraper Pro |
Posts, comments, subreddit data — JSON API |
No |
| Threads Scraper |
Posts and profiles from Threads |
No |
| Social Profile Scraper |
Cross-platform social profiles |
Varies |
YouTube Tools
| Tool |
What It Extracts |
| YouTube Comments Scraper |
Comments with metadata (Innertube API, no quota) |
| YouTube Channel Scraper |
Channel stats, videos, playlists |
| YouTube Search Scraper |
Search results with filters |
| YouTube Transcript Scraper |
Captions/subtitles in any language |
SEO & Web Analysis (16 tools)
| Tool |
What It Does |
| SEO Audit Tool |
50+ SEO factors, score 0-100 |
| Broken Links Checker |
Find dead links on any site |
| Website Tech Detector |
Identify tech stack (React, WordPress, etc.) |
| PageSpeed Scraper |
Performance metrics and scores |
| Sitemap Scraper |
Extract and parse XML sitemaps |
| Robots.txt Analyzer |
Check crawl rules and blocked paths |
| SSL Certificate Checker |
Verify SSL validity and expiry |
| WHOIS Domain Lookup |
Registration data for any domain |
| Meta Tags Extractor |
All meta tags including Open Graph |
| Keyword Density Analyzer |
Word frequency and SEO metrics |
| HTTP Headers Checker |
Security headers and caching |
| Email Extractor |
Find emails on any webpage |
| Email Validator |
MX record verification, disposable detection |
| Website Screenshot |
Full-page screenshot capture |
| Text Extractor |
Clean text from any webpage |
| Uptime Checker |
Website availability monitoring |
News & Content
| Tool |
Source |
| Google News Scraper |
Google News RSS feed |
| Hacker News Scraper |
HN stories and comments |
| RSS Feed Scraper |
Any RSS/Atom feed |
| Wikipedia Scraper |
Article content and metadata |
| arXiv Scraper |
Academic papers |
| Stack Overflow Scraper |
Q&A and discussions |
Business & Reviews
| Tool |
Source |
| Amazon Reviews Scraper |
Product reviews |
| Trustpilot Scraper |
Company reviews (JSON-LD) |
| Google Maps Scraper |
Business listings |
| Yelp Scraper |
Local business data |
| Indeed Jobs Scraper |
Job listings |
| Glassdoor Scraper |
Company reviews and salaries |
| Booking.com Scraper |
Hotel listings |
| Product Hunt Scraper |
Trending products |
Developer Tools
| Tool |
Source |
| GitHub Profile Scraper |
Developer profiles |
| GitHub Repo Scraper |
Repository data |
| GitHub Issues Scraper |
Bug reports and features |
| GitHub Trending Scraper |
Trending repos |
| npm Package Scraper |
Package metadata |
Utilities
| Tool |
What It Does |
| Domain Availability |
Check if domains are available |
| IP Geolocation |
Get location from IP address |
| JSON Formatter |
Validate and format JSON |
| URL Expander |
Resolve shortened URLs |
| Hashtag Generator |
Generate relevant hashtags |
| Country Info |
Country data (population, area, etc.) |
| Crypto Price Scraper |
Real-time crypto prices |
| Exchange Rate Scraper |
Currency conversion rates |
| Weather Scraper |
Current weather data |
15 MCP Servers for AI Agents
All tools above are also available as MCP-compatible servers for integration with Claude, GPT, and other AI agents. Full list of MCP servers.
How to Access
All tools are on the Apify Store — search for knotless_cadence:
- Browse all tools
- Free tier available for every tool
- REST API access for automation
Source Code
Full catalog with descriptions: awesome-web-scraping-2026
Also available: Market Research Reports — free AI/ML, SaaS, FinTech, HealthTech, E-commerce, and Cybersecurity market analysis reports.
Top comments (0)