Analysis of Steam VN user reviews

Forum organization and occasional community-building.
Forum rules
Questions about Ren'Py should go in the Ren'Py Questions and Announcements forum.
Post Reply
Message
Author
User avatar
BunnyAdvocate
Regular
Posts: 53
Joined: Fri Apr 14, 2017 5:21 pm
Tumblr: BunnyAdvocate
Contact:

Analysis of Steam VN user reviews

#1 Post by BunnyAdvocate »

Image

If the quote “our language is the reflection of ourselves” is true, then what could we learn from Steam user reviews (other than that we deserve every bad game ever published there)? I thought it’d be fun to generate some word clouds of Steam VN user reviews: what words tend to pop up in positive reviews vs negative ones, which words are overused in 18+ VNs, and how old can I make myself feel by seeing all these memes references.

Data collection

Using the Steam API, I collected the English user reviews for any VN released before 2019 on Steam, giving us 250,000 reviews in total. I filtered out Doki Doki Literature Club’s 71,000 reviews to prevent the results being skewed too heavily towards one VN. I also filtered out any word that appeared in fewer than 5 different VNs to prevent character names from popular VNs from filling up the results too much.

Word associations

A higher resolution set of these word-cloud images can be found here. The larger a word is the more frequently it’s used.

Image

First up is a comparison of what words tend to appear more often in VN reviews vs a random selection of other games on Steam. There’s nothing too surprising here, it’s mostly just popular VN series and various “weeaboo” terms. “Uncensored” also pops up quite prominently, showing how much 18+ content matters to the medium.

Image

Next is the list of words that are more likely to come up in reviews the user submitted as a thumbs-up (a positive review). While there’s all the usual flattering terms you’d expect, it’s fun to see how many words traditionally associated with negative feelings come up here: tears, cry, sadness, and bittersweet all show up indicating how much we seek a deep emotional release in VNs... also “memes.”

Image

What goes up must come down, here we have words that tend to come up in thumbs-down Steam reviews. Despite VNs being a visual medium, almost all the terms would seem to describe their opinion on the story/writing rather than the visuals, with “boring,” “waste,” and “stupid” all coming up more often than “ugly.” This suggests the most common way a VN can disappoint its users ie through its writing rather than its aesthetic, although this may because it’s easier to judge the visuals from screenshots before you purchase the VN.

Image

The English-developed VNs reviews are mostly full of titles of popular EVNs, but we can also see how much more socially progressive EVNs are, with terms like gender, diversity, and lgbt coming up more often than in JVNs.

Image

Truly Japan is the land of wonder, or at least kawaii catgirls according to these results. It’s curious that “fighting” would be linked to JVNs, perhaps because there’s so few EVNs that depict violence.

Image

Thank you Steam reviews for telling us in the review that a free VN is free. Truly a valuable service.

Image

There’s a certain irony that the words that come up more often in commercial VNs are all about how to get it cheaper: sale, bundle, and discount are all prominent terms.

Image

These are the words that tend to come up more often in otome VNs reviews (VNs with a female protagonist pursuing male love interests). Words associated with fantasy type settings pop up frequently, queen, princess, and prince are all present which is unsurprising given otome’s love of the fantasy genre.

Image

These are the cursed words which come up more often in 18+ VNs, what is lacking in eloquence is at least made up in “tiddies.”

Image

These are the words that tend to come up in shorter reviews. We’re told a picture paints a thousand words, but who needs a thousand words when you have swear words to convey meaning instead? Who needs verbose reviews when you have “fuck gay catgirl boobs.” I’m sold on that VN already.

You can find higher resolution versions of all these word cloud images here (as well as the longer-review wordcloud which wasn’t included here because it’s boring). You can also view the results in spreadsheet format here, which is useful for reading the smaller (less-common) words.

Review trends

I’d be ashamed to put my name to an analysis post that didn’t have a graph or two, so to cleanse the palette after all those word clouds here are a few graphs looking at some review statistics.

Image

Typically reviews tend to be fairly short, just a few sentences at 150 characters, but there’s no stopping the more long-winded of us who might be few in number, but dramatically pull up the average wordcount with their detailed account of everything that happens in a VN.

Image

I expected that the longer a review was, the more likely it would be that the reviewer liked it. It’s the fans who want to talk about it the most isn’t it? Well it turns out to be the other way around, the longer a review is, the more likely it is that the reviewer disliked it. Perhaps unhappy user’s feel the need to justify their opinion more when it goes against the general positive consensus on Steam, where 86% of all reviews are positive. So in accordance with this trend and the excessive length of this post, I hereby give my Steam VN review analysis a thumbs down. Not enough kawaii catgirls.

While I don’t think any of these results were surprising, I hope you found it a fun read. If you’re interested in more, check out my other posts on tumblr. Feel free to give any feedback or suggestions for other analyses either here, twitter, or Discord (Sunleaf_Willow /(^ n ^=)\#1616).

Thanks to Lunaterra, /u/8cccc9, and Elm for their input during this analysis.

User avatar
Gery
Regular
Posts: 26
Joined: Mon Feb 25, 2019 7:41 pm
Contact:

Re: Analysis of Steam VN user reviews

#2 Post by Gery »

WOW! Thank you for sharing this with us, BunnyAdvocate! I'm surprised at the "frequency level" of the word "Kinetic" in the first graph. One of the reasons why I got into VNs is because I see them as the next evolution of books. But I like the choices and the different routes you can take. :D I wonder whether people just want to read a good story and not worry about choices. Interesting...

Short reviews - frequent words: "F***" and "F***ING" ??? HAHAHA! And "Definitely" is misspelt twice!! XD Right spelling is nowhere to be seen.

Thanks again! :)

User avatar
BunnyAdvocate
Regular
Posts: 53
Joined: Fri Apr 14, 2017 5:21 pm
Tumblr: BunnyAdvocate
Contact:

Re: Analysis of Steam VN user reviews

#3 Post by BunnyAdvocate »

@Gery Haha yeah I loved some of the misspellings. Both "recommend" and "reccommend" made it into one of the charts about equally, which made me feel a little better because I've fallen into using the misspelt "reccommend" more than a few times.

I think "kinetic" was so prominent where "multiple" or the like didn't is because it's a word that's so rarely used in normal conversation. Words used to describe multiple routes can often be used to talk about other things, but folks often don't often use "kinetic" outside of physics lessons or VN reviews.

User avatar
Zelan
Lemma-Class Veteran
Posts: 2436
Joined: Tue Mar 01, 2016 7:23 pm
Completed: The Dark
Projects: Cosplay Couple
Tumblr: evns
itch: Zelan
Discord: ltnkitsuragi#7082
Contact:

Re: Analysis of Steam VN user reviews

#4 Post by Zelan »

These are important and interesting results and all but I'm laughing my ass off over "homestuck" in the bottom right of the EVN graph.

User avatar
BunnyAdvocate
Regular
Posts: 53
Joined: Fri Apr 14, 2017 5:21 pm
Tumblr: BunnyAdvocate
Contact:

Re: Analysis of Steam VN user reviews

#5 Post by BunnyAdvocate »

Zelan wrote: Mon Mar 11, 2019 3:07 pm These are important and interesting results and all but I'm laughing my ass off over "homestuck" in the bottom right of the EVN graph.
Haha yeah I'm curious why people are mentioning that. AFAIK Homestuck was kind of famous for having kickstarted a game that never got released, but it wasn't a VN so I'm not sure why it's turning up in VN reviews.

User avatar
papillon
Arbiter of the Internets
Posts: 4107
Joined: Tue Aug 26, 2003 4:37 am
Completed: lots; see website!
Projects: something mysterious involving yuri, usually
Organization: Hanako Games
Tumblr: hanakogames
Contact:

Re: Analysis of Steam VN user reviews

#6 Post by papillon »

They did release a game and it does have a Visual Novel tag on Steam:

https://store.steampowered.com/app/8330 ... Friendsim/

User avatar
BunnyAdvocate
Regular
Posts: 53
Joined: Fri Apr 14, 2017 5:21 pm
Tumblr: BunnyAdvocate
Contact:

Re: Analysis of Steam VN user reviews

#7 Post by BunnyAdvocate »

papillon wrote: Tue Mar 12, 2019 6:32 am They did release a game and it does have a Visual Novel tag on Steam:

https://store.steampowered.com/app/8330 ... Friendsim/
Ah thanks! That'll be what it's picking up then. I didn't notice it as the title didn't make mention of Homestruck.

Post Reply

Who is online

Users browsing this forum: No registered users