DEV Community

Cover image for Day 28 of improving my Data Science skills
Sylvester Promise
Sylvester Promise

Posted on

Day 28 of improving my Data Science skills

Today, I switched things up. Instead of just talking about it, I recorded a short video showing how I solved a real Web Scraping exercise using Scrapy.

https://www.loom.com/share/c70bb3df17ba4e34b0db37a794d401cc

Specifically,I used response.follow() to navigate through the links I scraped.

Alongside this, I also worked through several exercises in Introduction to Statistics in Python, focusing on:
Using scatterplots to see relationships
Computing correlation coefficients
Knowing when to use correlation after visualization

Even though I didn't record the statistics exercises, they strongly complemented today's scraping work. One helps you collect data, the other helps you reason about what that data actually means.

I'm enjoying documenting not just what I'm learning, but how I approach problems, step by step.

-SP

Top comments (0)