myNextProject

I have a certification in full stack web development using html, css, javascript, react, node, express, sql, mongo, etc.

I'd say that I only retained about 40% of it. mostly vanilla javascript. My current job is in Python - almost exclusively in a scraping context.

I have identified a few gaps in my knowledge that I want to work on.

Since I started to do more learning outside of work, I learned Redux and Terraform. I was pretty sure that Terraform would have landed me a job if it werent for Covid-19. Oh well.

My next project, one that I need some accountability to actually see through, is to use node.js and puppeteer to scrape https://www.footballdb.com/ and create a SQL database. This way I get more node experience, and I can learn a different way of scraping. With the output from the scrapes, I will be able to....make SQL Queries? I dont know what I'm doing with SQL well at all, but I need something where I understand the data if I want to create tables out of it.

So here is my plan written down:

1. Build scrape in node/puppeteer
2. Send output to templated SQL command seed dump...thing
3. ???
4. Profit...in SQL.

It's not a perfect plan. I need to download a SQL program still, and there are other hurdles, I'm sure. Additionally, I am also sure that there are easier ways to achieve this goal, but I want to do it this way as a learning experience.

Any thoughts, comments, or words of encouragement would be wonderful. Thank for reading :)