Hello folks!!
https://github.com/shreyvijayvargiya/scrapefast/
I’ve built the smallest and fastest web scraping free open-source Node. js-based endpoint.
- Handles concurrent multiple URL scraping
- Manage memory allocation, cache cleaning
- API endpoints for scraping, screenshot for a single URL and multiple URL Most of the AI LLMs need internet access and web scraping for reading content from a website/URL, and a web scraping endpoint will help in the same way
Wrote a detailed blog about it, read blog: https://ihatereading.in/t/One-honojs-file-for-entire-web-scraping-API
Feel free to contribute
Cheers
Shrey
Top comments (0)