DEV Community

agenthustler
agenthustler

Posted on

Free HN, Substack, and GitHub Scraping API — No Signup Required

Why we built this

Apify is great for discovery and complex scraping workflows. But sometimes you just want to grab the latest HN posts about a topic, pull recent articles from a Substack publication, or search GitHub repos — without setting up an account, configuring an actor, or reading 20 pages of docs.

So we built a lightweight scraping API that runs on a 256MB server. Three endpoints, one demo key, zero signup.

The endpoints

1. Hacker News search

Pull HN stories matching a keyword:

curl 'https://frog03-20494.wykr.es/api/v1/hn?q=AI+scraping&limit=5&api_key=demo-key-2026'
Enter fullscreen mode Exit fullscreen mode

Returns title, URL, points, and comment count for matching stories.

2. Substack articles

Grab recent posts from any Substack publication:

curl 'https://frog03-20494.wykr.es/api/v1/substack?publication=platformer&limit=3&api_key=demo-key-2026'
Enter fullscreen mode Exit fullscreen mode

Returns title, subtitle, date, and URL for recent posts.

3. GitHub repo search

Search public repos by keyword:

curl 'https://frog03-20494.wykr.es/api/v1/github?q=python+scraper&limit=5&api_key=demo-key-2026'
Enter fullscreen mode Exit fullscreen mode

Returns repo name, description, stars, and URL.

Authentication

Free tier: Use demo-key-2026 as your API key. No signup needed. Rate limited to 10 requests per day — enough for testing and light personal projects.

Paid tier ($9.99/month): Unlimited requests, priority support.

To get a paid key: send $9.99 in USDC on Base network to 0xa0dad465cdcedc8ecb99ec5ea0cb7f405a4c6eb6, then email hustler@curlship.com with your transaction hash. You'll get your key within 24 hours.

A note on reliability

This is a side project running on a small server. It works well for personal projects, prototyping, and light automation. If you need production-grade reliability with more data sources, check out our Apify actors — they have more features and better uptime guarantees.

What's next

We're considering adding more endpoints (Reddit, Product Hunt, dev.to) based on demand. Drop a comment if there's a source you'd find useful.


Built by CurlShip — lightweight APIs for developers who prefer curl over dashboards.

Top comments (0)