I'm a self-taught dev focused on websites and Python development.
My friends call me the "Data Genie".
When I get bored, I find tech to read about, write about and build things with.
Ah, interesting question. I'm enjoying the other responses. I want to share 3 of my cron-related projects.
scrape_pages_with_curl.sh I'm interested in scraping data from certain news and property sites to understand the water crisis in my city. I've done that for over a year.
twitterverse I download Twitter API data daily using a tool I wrote. I run it to fetch trend data from countries and cities. And also to get tweets for a couple of search queries of interest to me and friends.
uni-cron Unfortunately, crontab alone can't run them reliably on a laptop which is not always on and online. And running all jobs hourly (when they only need to run once a day) is overkill for resources, but that's what I've been today. But, as of yesterday, I have a tool what integrates with crontab that will run your tasks exactly once a day and will keep retrying them throughout the day if they fail. Keen to hear thoughts on this! Or to find if there is a solution for Mac out there already.
For further actions, you may consider blocking this person and/or reporting abuse
We're a place where coders share, stay up-to-date and grow their careers.
Ah, interesting question. I'm enjoying the other responses. I want to share 3 of my cron-related projects.
scrape_pages_with_curl.sh I'm interested in scraping data from certain news and property sites to understand the water crisis in my city. I've done that for over a year.
twitterverse I download Twitter API data daily using a tool I wrote. I run it to fetch trend data from countries and cities. And also to get tweets for a couple of search queries of interest to me and friends.
uni-cron Unfortunately, crontab alone can't run them reliably on a laptop which is not always on and online. And running all jobs hourly (when they only need to run once a day) is overkill for resources, but that's what I've been today. But, as of yesterday, I have a tool what integrates with crontab that will run your tasks exactly once a day and will keep retrying them throughout the day if they fail. Keen to hear thoughts on this! Or to find if there is a solution for Mac out there already.