{"id":1889,"date":"2014-02-24T09:46:35","date_gmt":"2014-02-24T08:46:35","guid":{"rendered":"http:\/\/www.stevebromley.com\/blog\/?p=1889"},"modified":"2019-11-06T17:44:58","modified_gmt":"2019-11-06T16:44:58","slug":"how-important-is-games-usability-to-reviewers","status":"publish","type":"post","link":"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/","title":{"rendered":"How important is games usability to reviewers?"},"content":{"rendered":"<p>As games user researchers, we consider usability to be a major factor in the quality of games. However it is not the only aspect that makes games \u201cgood\u201d. A game could have fantastic usability, and yet still be boring.<\/p>\n<p>In order to get a snapshot of the importance of usability for game quality, I have looked at some games released last year and listed all the issues found in reviews. For each issues I\u2019ve determined whether the issue is a usability problem, or whether it\u2019s something else \u2013 anything from appeal (\u201cthe character is ugly\u201d), to the concept (\u201cwe\u2019re bored of farming simulators\u201d).<\/p>\n<p>From this I hope to gain a greater understanding of how important usability issues are to games reviewers.<\/p>\n<p><!--more--><\/p>\n<p>Let\u2019s put a disclaimer up front also \u2013 this isn\u2019t an academic study and so I\u2019ve picked some arbitrary games to look at \u2013 eurogamer\u2019s reviews for the top 3, mid 3 and bottom 3 metacritic rated games from last year. Where eurogamer didn\u2019t review the metacritic rated game, I moved onto the next game until I found one they had reviewed.\u00a0 I picked eurogamer as it\u2019s my preferred review source \u2013 like I said, I\u2019m not being academic!<\/p>\n<p>First we\u2019ll look at the findings, and then consider what this means about games usability and reviews.<\/p>\n<p><b>The Games:<\/b><\/p>\n<p><b>Grand Theft Auto 5<\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-09-16-grand-theft-auto-5-review\">http:\/\/www.eurogamer.net\/articles\/2013-09-16-grand-theft-auto-5-review<\/a><\/li>\n<li><b>Metacritic: <\/b>97%<\/li>\n<li><b>Usability Issues<\/b>: 0<\/li>\n<li><b>Non-Usability Issues<\/b>: 4<\/li>\n<li><b>% of issues<\/b>: 0%<\/li>\n<li><b>Sample usability issue: <\/b>N\/A<\/li>\n<\/ul>\n<p><b>\u00a0<\/b><\/p>\n<p><b>The Last of Us<\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-06-05-the-last-of-us-review\">http:\/\/www.eurogamer.net\/articles\/2013-06-05-the-last-of-us-review<\/a><b> <\/b><\/li>\n<li><b>Metacritic: <\/b>95%<\/li>\n<li><b>Usability Issues<\/b>: 0<\/li>\n<li><b>Non-Usability Issues<\/b>: 2<\/li>\n<li><b>% of issues<\/b>: 0%<\/li>\n<li><b>Sample usability issue: <\/b>N\/A<\/li>\n<\/ul>\n<p><b>\u00a0<\/b><\/p>\n<p><b>Bioshock Infinite<\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-03-25-bioshock-infinite-review\">http:\/\/www.eurogamer.net\/articles\/2013-03-25-bioshock-infinite-review<\/a><\/li>\n<li><b>Metacritic: <\/b>94%<\/li>\n<li><b>Usability Issues<\/b>: 0<\/li>\n<li><b>Non-Usability Issues<\/b>: 2<\/li>\n<li><b>% of issues<\/b>: 0%<\/li>\n<li><b>Sample usability issue: <\/b>N\/A<\/li>\n<\/ul>\n<p><b>\u00a0<\/b><\/p>\n<p><b>Killer Instinct<\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-11-20-killer-instinct-review\">http:\/\/www.eurogamer.net\/articles\/2013-11-20-killer-instinct-review<\/a><\/li>\n<li><b>Metacritic: <\/b>73%<\/li>\n<li><b>Usability Issues<\/b>: 1<\/li>\n<li><b>Non-Usability Issues<\/b>: 7<\/li>\n<li><b>% of issues<\/b>: 13%<\/li>\n<li><b>Sample usability issue: <\/b>The depth of the combo system is initially hidden: <i>\u201cAt first Killer Instinct comes across a little too combo-heavy, almost to the point of feeling mindless\u201d<\/i><\/li>\n<\/ul>\n<p><b>\u00a0<\/b><\/p>\n<p><b>Amnesia: A Machine for Pigs<\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-09-09-amnesia-a-machine-for-pigs-review\">http:\/\/www.eurogamer.net\/articles\/2013-09-09-amnesia-a-machine-for-pigs-review<\/a><b> <\/b><\/li>\n<li><b>Metacritic: <\/b>72%<\/li>\n<li><b>Usability Issues<\/b>: 0<\/li>\n<li><b>Non-Usability Issues<\/b>: 6<\/li>\n<li><b>% of issues<\/b>: 0%<\/li>\n<li><b>Sample usability issue: <\/b>N\/A<\/li>\n<\/ul>\n<p><b>\u00a0<\/b><\/p>\n<p><b>Rain<\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-10-01-rain-review\">http:\/\/www.eurogamer.net\/articles\/2013-10-01-rain-review<\/a><\/li>\n<li><b>Metacritic: <\/b>72%<\/li>\n<li><b>Usability Issues<\/b>: 1<\/li>\n<li><b>Non-Usability Issues<\/b>: 4<\/li>\n<li><b>% of issues<\/b>: 20%<\/li>\n<li><b>Sample usability issue: <\/b>Prompts are too obvious:<i> \u00a0\u201cthey often have to intrude into the action to guide you &#8211; occasionally with a flashing object like a switch or a grate &#8211; It&#8217;s like reading a fairy tale in which someone has helpfully underlined all the important bits for you\u201d<\/i><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><b>Walking Dead: Survival Instinct <\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-04-03-the-walking-dead-survival-instinct-review\">http:\/\/www.eurogamer.net\/articles\/2013-04-03-the-walking-dead-survival-instinct-review<\/a><\/li>\n<li><b>Metacritic: <\/b>38%<\/li>\n<li><b>Usability Issues<\/b>: 2<\/li>\n<li><b>Non-Usability Issues<\/b>: 8<\/li>\n<li><b>% of issues<\/b>: 20%<\/li>\n<li><b>Sample usability issue: <\/b>Interactive elements are hidden: <i>\u201cpoxy doors that don&#8217;t open but look the same as the ones that do.\u201d<\/i><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><b>Fighter Within<\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-11-29-fighter-within-review\">http:\/\/www.eurogamer.net\/articles\/2013-11-29-fighter-within-review<\/a><\/li>\n<li><b>Metacritic: <\/b>23%<\/li>\n<li><b>Usability Issues<\/b>: 2<\/li>\n<li><b>Non-Usability Issues<\/b>: 6<\/li>\n<li><b>% of issues<\/b>: 13%<\/li>\n<li><b>Sample usability issue: <\/b>The game doesn\u2019t recognise its gesture controls: <i>\u201cKinect struggles to comprehend the most basic of hand movements. Performing simple actions requires gargantuan amounts of perseverance and luck, and frequently leaves you frustrated, furious and exhausted. And that&#8217;s just the menu screens.\u201d<\/i><\/li>\n<\/ul>\n<p><b>\u00a0<\/b><\/p>\n<p><b>Ride to Hell Retribution<\/b><\/p>\n<ul>\n<li><b>Review: <\/b><a href=\"http:\/\/www.eurogamer.net\/articles\/2013-07-10-ride-to-hell-retribution-review\">http:\/\/www.eurogamer.net\/articles\/2013-07-10-ride-to-hell-retribution-review<\/a><\/li>\n<li><b>Metacritic: <\/b>13%<\/li>\n<li><b>Usability Issues<\/b>: 8<\/li>\n<li><b>Non-Usability Issues<\/b>: 7<\/li>\n<li><b>% of issues<\/b>: 53%<\/li>\n<li><b>Sample usability issue: <\/b>Unclear where to go: \u201c<i>the level design was so ambiguous about where I should go next that I pressed myself up against every unopenable door, of which there are at least a tantalising 10 in each level, for a chance to press E to open, only to realise that warehouse walls sometimes slide<\/i><\/li>\n<\/ul>\n<p><b>\u00a0<\/b><\/p>\n<p><b>What does this mean?<\/b><\/p>\n<p>Usability issues are mentioned in some reviews, so they are a concern of reviewers and are presumably accounted into the game\u2019s score. Furthermore, we can see that these top games reported no usability issues (and few non-usability issues). Reading the reviews could give the impression that high profile games do not have any usability issues \u2013 however this isn\u2019t true. Having just played Bioshock Infinite there were a number of small usability annoyances that persisted through the game (Why do characters insist on talking over the Voxophones!).<\/p>\n<p>So it seems that \u2018lesser\u2019 usability issues do not warrant a mention in the text of the review (although this doesn\u2019t mean that they aren\u2019t factored into the game\u2019s score).<\/p>\n<p>With the mid and lower-tier games more problems were found, which covered both non-usability issues (such as the misogyny in Ride to Hell Retribution), as well as the usability issues. In these reviews usability issues were identified and explicitly mentioned in the text of the review, and presumably factored into the score.<\/p>\n<p>The impression I got from looking at these reviews is that while fixing usability issues won\u2019t ensure you make a great game, it will stop you from making a terrible game. You can reach a mid-tier score (around 73%) with usability issues in the game, but the top rated games have spent the time and money to identify and remove usability issues, and this is reflected in eurogamer\u2019s reviews.<\/p>\n<p>With a lot more time, there may be benefit in performing this task over multiple review sources, and all games \u2013 which sounds like a dissertation topic to me!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As games user researchers, we consider usability to be a major factor in the quality of games. However it is not the only aspect that makes games \u201cgood\u201d. A game could have fantastic usability, and yet still be boring. In order to get a snapshot of the importance of usability for game quality, I have [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[117],"tags":[],"class_list":["post-1889","post","type-post","status-publish","format-standard","hentry","category-games-user-research","grve-entry-item","grve-blog-item"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v15.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How important is games usability to reviewers? - Steve Bromley - User Research<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How important is games usability to reviewers? - Steve Bromley - User Research\" \/>\n<meta property=\"og:description\" content=\"As games user researchers, we consider usability to be a major factor in the quality of games. However it is not the only aspect that makes games \u201cgood\u201d. A game could have fantastic usability, and yet still be boring. In order to get a snapshot of the importance of usability for game quality, I have [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/\" \/>\n<meta property=\"og:site_name\" content=\"Steve Bromley - User Research\" \/>\n<meta property=\"article:published_time\" content=\"2014-02-24T08:46:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-11-06T16:44:58+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#website\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/\",\"name\":\"Steve Bromley - User Research\",\"description\":\"Usability and User Research for Websites, Software and Games\",\"publisher\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/www.stevebromley.com\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/#webpage\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/\",\"name\":\"How important is games usability to reviewers? - Steve Bromley - User Research\",\"isPartOf\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#website\"},\"datePublished\":\"2014-02-24T08:46:35+00:00\",\"dateModified\":\"2019-11-06T16:44:58+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/\",\"name\":\"How important is games usability to reviewers?\"}}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/#webpage\"},\"author\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"headline\":\"How important is games usability to reviewers?\",\"datePublished\":\"2014-02-24T08:46:35+00:00\",\"dateModified\":\"2019-11-06T16:44:58+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/#webpage\"},\"commentCount\":3,\"publisher\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"articleSection\":\"Games User Research\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.stevebromley.com\/blog\/2014\/02\/24\/how-important-is-games-usability-to-reviewers\/#respond\"]}]},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\",\"name\":\"Steve Bromley\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4dfbbfc5a00187fd6f5fd405361347b2698a65a866f49de07f9486895b6c7029?s=96&d=mm&r=g\",\"caption\":\"Steve Bromley\"},\"logo\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#personlogo\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/1889","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/comments?post=1889"}],"version-history":[{"count":12,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/1889\/revisions"}],"predecessor-version":[{"id":1901,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/1889\/revisions\/1901"}],"wp:attachment":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/media?parent=1889"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/categories?post=1889"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/tags?post=1889"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}