Hey guys ;)
It’s been a while since my last post. Actually I was a bit busy and forgot to write about progress. And this time I really have what to say. So what happened in short?
- Scraper ended data extending.
- Pageviews script added pageview info for all 6k books.
- My first analysis notebook is done.
So, here is a fragment of my extended data before pageviews.
And here is a fragment of dataset after pageviews.
Is pageview extending false?
As I said in a previous post, sometimes Wikipedia pageviews give some nonsense data, and it’s true. Barely it gives an exact match, more often it gives the author page, and most of the time it gives 0 or some nonsense.
When I’ll start my second analysis notebook, I’ll do something about that, maybe erase some data, for example if the saved Wiki title is in author or in title, I don’t know yet.
Here is my pageview script fragment.
First conclusions
When I began this project I asked a question, do people read less nowadays? Actually I don’t know. According to my data I couldn’t say that people read less or people read more nowadays. All I could say it’s that people still read some books indeed.
Again all ,my conclusion here will be true according to my scrapped data, custom standard of books popularity and validity for Ukraine reading culture.
So, people prefer physical books more, the most popular author is Hiro Mashima, because of the number of his manga volumes. The most popular publishers are those who produce manga and comics, again because of the number of volumes and parts. The amount of books released in the last 10 years is bigger than the amount of books released 10-20+ years ago. And the most popular categories are manga, comics, autobiography and memoirs, self-improvement and children literature. Charts from notebook I’ll add too.
What do I mean by using the words popular or famous? So in my dataset there are 6k books. And for each analysis I’ve used count. So the most popular author is who has the most amount of books. And I should remind you, that it isn’t some 6k books, it's the best books according to my custom standard.
Next step
I think the next step is going to be the last. I don’t know, maybe I’ll do all the code tomorrow, or next week. So what do I need to do?
- Analyse books, their popularity according to standard and to pageviews.
- Write something between code.
- Write final conclusion and README.md (with some screenshots to show what this project is about very quickly, without opening notebooks).
- Push and commit everything.
Top comments (0)