DEV Community

Cover image for Introducing Open Video Game Data: A new approach to evaluating games.
André N. Darcie
André N. Darcie

Posted on

Introducing Open Video Game Data: A new approach to evaluating games.

Introduction

My friend Diego and I decided to create a non-profit site called Open Video Game Data with active community participation. Our idea is to offer an alternative to well-known sites like Metacritic and OpenCritic, but with a different approach. Instead of being a score aggregator, we will be a list aggregator.

Our mission is to provide an open, collaborative platform where users can contribute their unique perspectives and enrich the diversity of assessments available.

Metacritic brings together reviews from multiple review sites in one place, providing a final score of 0-100 based on a weighted arithmetic average, where some critics carry more weight than others. An alternative to Metacritic is OpenCritic, where all critics are weighted equally in the final average. However, both still work with numeric scores.

Why relying on scores can be problematic?

Ratings only reflect the state of the game at launch

Today, more than ever, games are constantly evolving. It is common to have "patch day one", that is, games released with bugs and incomplete content. However, with time and help from the community, these games can be improved, as was the case with No Man's Sky.

When No Man's Sky was released in 2016, its average on Metacritic was just 61, due to the troubled release. However, over the years, the game has evolved significantly with updates and feedback from the community, becoming a critically acclaimed and commercial success. It has won awards at events such as The Game Awards and British Academy Games Awards, but its Metacritic score remains frozen at 61, not reflecting its current quality.

Alternative: As the lists are constantly evolving and updating, they more accurately reflect the current quality of the games, tracking their improvements and changes over time.

The gaming industry evolves, but scores don't

Games that are highly acclaimed at launch can lose their luster over time, especially when other sequels and titles raise the bar for the industry. However, as the averages are frozen in time, they may favor games that are historical but have aged poorly and would not necessarily make good recommendations today.

Alternative: Games that have aged badly can be deleted from the lists, while those that remain relevant can be re-rated in different positions, reflecting their changes over time.

The average score can be unfair as it is based on the amount of critics

Sometimes, the amount of crits heavily influences a game's rating. An example of this is The Legend of Zelda: Ocarina of Time, with an average of 99 on Metacritic, based on 22 critics. While The Legend of Zelda: Breath of the Wild averages a 97, based on 109 critics. Getting a high average based on a large number of critics is extremely difficult, and this can influence the overall perception of a game.

Alternative: When a final list is created, all games have an equal chance of appearing in different lists. For example, game A might be included in 3 out of 11 lists, while game B might be mentioned in 5 out of 11 lists. The total amount of lists will always be the same for all games.

Relying on an average can be inaccurate

Metacritic converts the different rating scales of review sites into a single percentage-based quantitative scale. However, this conversion can be inaccurate and unfair, as each site uses different rating systems. This approach can result in important information being lost during conversion, affecting the accuracy of the final result.

Alternative: With our ranked lists approach, we eliminate the need to convert rating systems, as all lists, regardless of site, follow the same common logic. In all lists, there will always be first place, second place, and so on.

A great alternative: Open Video Game Data

Our site aims to be just another alternative to note-based sites. Our approach to aggregating lists allows users to have a more comprehensive and up-to-date view of games as these lists are constantly updated by the community.

The calculation method is quite simple and transparent. All lists on the site have a maximum size of 15 games. When a game ranks first in a list, it is rewarded with 15 points, while if it ranks last, it only receives 1 point.

Here is an example of the final generated list:

🏆 The Best Games of All Time

  1. 🥇 The Legend of Zelda: Breath of the Wild (2017) - 15 lists (75%) - score: 177
  2. 🥈 Tetris (1984) - 9 lists (45%) - score: 116
  3. 🥉 The Legend of Zelda: Ocarina of Time (1998) - 10 lists (50%) - score: 104
  4. The Last of Us (2013) - 11 lists (55%) - score: 95
  5. Half-Life 2 (2004) - 10 lists (50%) - score: 86
  6. Minecraft (2011) - 10 lists (50%) - score: 80
  7. Super Mario 64 (1996) - 8 lists (40%) - score: 80
  8. The Witcher 3: Wild Hunt (2015) - 8 lists (40%) - score: 77
  9. Super Mario World (1990) - 7 lists (35%) - score: 69
  10. Portal 2 (2011) - 6 lists (30%) - score: 69
  11. Grand Theft Auto V (2013) - 10 lists (50%) - score: 64
  12. Final Fantasy VII (1997) - 5 lists (25%) - score: 60
  13. Metal Gear Solid (1998) - 6 lists (30%) - score: 57
  14. Street Fighter II (1991) - 9 lists(45%) - score: 56
  15. Resident Evil 4 (2005) - 6 lists (30%) - score: 50

Based on 20 lists of the following critics: IGN, Parade, Moviemaker, GamesRadar+, FTW USA Today, Popularmechanics, Polygon, Videogamecanon, Svg, Gaming, Esquire, Gamingbolt, Videogames, Hobbyconsolas, Youtube, Digitaltrends, Gq-magazine, SensCritique, Opencritic, Metacritic.

Source: https://www.openvideogamedata.com/list/the-best-games-of-all-time/critics

Active community participation

We value active community participation in Open Video Game Data. Users are free to find critics' lists, such as those on IGN, and suggest inclusion of those lists on our site. These suggestions go through a community feedback process and are then reviewed and approved by our administrators.

We believe in transparency and accessibility of data, so lists of critics and also lists with the opinions of users are welcome on our platform. When approved, these lists are aggregated to the final list of their respective categories.

Image description

Conclusion

Open Video Game Data seeks to provide gamers and game enthusiasts with a reliable tool to make informed decisions about which games to play, taking into account critics' opinions and the ongoing evolution of the gaming industry. With the active participation of the community, users can add critic lists and can also create personal lists that are also aggregated, we hope to build an inclusive and reference platform for the gaming community, promoting a more complete and updated analysis about the games that so much we love.

Come be part of our community! Create an account and join us to explore the world of playlists. Welcome to Open Video Game Data! Visit us at: https://www.openvideogamedata.com/

Top comments (5)

Collapse
 
felipeozalmeida profile image
Felipe Almeida

This has become quite common for games released in a bad state that have improved over time to get eternally low scores. Steam even protects games from "review bombing" as in the case of Cyberpunk 2077. Very good!

Collapse
 
karishmashukla profile image
Karishma Shukla

Love this.

Collapse
 
michaeltharrington profile image
Michael Tharrington

Really cool idea, André!

Collapse
 
jeanthomaz profile image
Jean Thomaz Jardim

Innovative idea, awesome!

Collapse
 
johnm0695176709 profile image
John M

Introducing Open Video Game Data, a groundbreaking approach to evaluating games! In this era of rapidly evolving gaming experiences, Open Video Game Data offers a transparent and collaborative platform where gamers and developers alike can contribute and access comprehensive information about games. From gameplay mechanics and storyline depth to graphics quality and player feedback, every aspect of a game's performance is meticulously documented. By embracing this open-data model, gamers can make informed decisions about their next gaming adventure, while developers can gain valuable insights to enhance their creations. Take Konis Game and More, for instance; its inclusion in the Open Video Game Data catalog enables players to explore detailed reviews, ratings, and user experiences, empowering them to choose an immersive gaming platform that suits their preferences. Embrace the power of Open Video Game Data and usher in a new era of informed gaming choices!

Some comments may only be visible to logged-in visitors. Sign in to view all comments.