Posted March 23, 2014
Despite the tongue-twister title of this thread, it actually has a serious topic: what is the best way to use reviews of a game to decide whether or not you should buy it?
I've been doing a survey of the user reviews of some of the games I've purchased here on GoG.com, paying especially close attention to the games I found disappointing and the games I found to be much better than expected. My goal is to figure out what to look for in a user review, and what to ignore, in order to get an accurate picture of a particular game. Here are my preliminary ideas.
1) Throw out all 5-star reviews, and all 1-star reviews.
Now, this is not perfect. There are lots of games out there that deserve 5 stars, and a few that deserve 1 star. However, there are simply far too many 5-star reviews, because it seems to be a natural human tendency to overrate things. Try to discern which 5-star reviews are accurate when 85% of them for any particular game are 5-star. It's impossible. On the other hand, 1-star reviews, although fewer in number, tend to be the most thoughtless reviews of all. If you spend some time reading 1-star reviews, you'll see things like, "I started it up once and it didn't work. One star." That's not helpful at all. Many of them are written by individuals who had technical problems of one kind or another, but unless it's a technical problem that affects everyone across the board, it doesn't say much about the game itself. Finally, based on my short survey, 4-star and 2-star reviews both tend to be more thoughtful and accurate than 5- or 1-star reviews.
2) Try to differentiate between kinds or praise and kinds of criticism.
What I mean is, if a positive review starts with, "I played this game all the time when I was 12!" that's not a very sound basis for an opinion. It doesn't really tell you what the game will be like for an adult. Similarly, you might see a negative review of a game that complains about the graphics, even if the game was made in 1996. That's also not very helpful. On the other hand, if you see a positive review that says, "This game has been on my hard drive for 15 years, and I still play it," that's probably a good sign. On the whole, judging the different kinds of praise and criticism is more subjective than my first suggestion, so I recommend figuring it out for yourself. But you should do it.
Hopefully others have more ideas to contribute. Thanks.
I've been doing a survey of the user reviews of some of the games I've purchased here on GoG.com, paying especially close attention to the games I found disappointing and the games I found to be much better than expected. My goal is to figure out what to look for in a user review, and what to ignore, in order to get an accurate picture of a particular game. Here are my preliminary ideas.
1) Throw out all 5-star reviews, and all 1-star reviews.
Now, this is not perfect. There are lots of games out there that deserve 5 stars, and a few that deserve 1 star. However, there are simply far too many 5-star reviews, because it seems to be a natural human tendency to overrate things. Try to discern which 5-star reviews are accurate when 85% of them for any particular game are 5-star. It's impossible. On the other hand, 1-star reviews, although fewer in number, tend to be the most thoughtless reviews of all. If you spend some time reading 1-star reviews, you'll see things like, "I started it up once and it didn't work. One star." That's not helpful at all. Many of them are written by individuals who had technical problems of one kind or another, but unless it's a technical problem that affects everyone across the board, it doesn't say much about the game itself. Finally, based on my short survey, 4-star and 2-star reviews both tend to be more thoughtful and accurate than 5- or 1-star reviews.
2) Try to differentiate between kinds or praise and kinds of criticism.
What I mean is, if a positive review starts with, "I played this game all the time when I was 12!" that's not a very sound basis for an opinion. It doesn't really tell you what the game will be like for an adult. Similarly, you might see a negative review of a game that complains about the graphics, even if the game was made in 1996. That's also not very helpful. On the other hand, if you see a positive review that says, "This game has been on my hard drive for 15 years, and I still play it," that's probably a good sign. On the whole, judging the different kinds of praise and criticism is more subjective than my first suggestion, so I recommend figuring it out for yourself. But you should do it.
Hopefully others have more ideas to contribute. Thanks.