DEV Community

loading...

Discussion on: Is there a topic you wish there was an article about?

Collapse
michaelcurrin profile image
Michael

What I'd be interested in is a guide to scraping in the cloud with free tier and without breaking terms of use (services which don't want to host a scraper)

Such as using GitHub Actions on a schedule to query Twitter API or save a given HTML page. And then to persist in one of the many free database services like BackendLess or FaunaDB or Hasura or Firebase.