{"id":882,"date":"2010-06-01T17:15:36","date_gmt":"2010-06-01T16:15:36","guid":{"rendered":"http:\/\/www.stevebromley.com\/blog\/?p=882"},"modified":"2019-11-06T17:45:02","modified_gmt":"2019-11-06T16:45:02","slug":"games-usability-testing-is-not-qa","status":"publish","type":"post","link":"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/","title":{"rendered":"Games Usability Testing is not QA!"},"content":{"rendered":"

As an emerging field, the aims and characteristics of usability and player experience testing can often be unknown or unrecognised within game companies, outside of a few key industry leaders, such as Valve and Bungie. This can often lead to comparisons being made with QA testing, or confusing usability testing as an element of QA. As an already established area of game development, it\u2019s a common misconception that they are the similar, or the same fields. This is not the case<\/p>\n

There are similar elements, as both involve considering the end user\u2019s experience, and involve getting players to physically play the game. However, they have different goals, and this is what I will be covering today, by looking briefly at the aims of QA, the aims of usability testing and how they differ.<\/p>\n

What is QA?<\/h4>\n

Quality Assurance (or Assessment) is an established field within game development. Often performed at both a developer and publisher level, it typically involves a room full of underpaid gamers endlessly playing a game in every conceivable way. They\u2019re looking for bugs, which will be documented and then passed on to the coding or art department.<\/p>\n

Typical bugs would be \u201cthe hitbox on that model is wrong\u201d, or \u201cwhen you shoot the tires on that Jaguar E Type, it makes a metal ricochet sound, not a rubber one\u201d. So the task is largely monotonous, and will involve running into every wall in the game, and testing every dialogue choice, to find one which gives an unexpected result. Moving beyond bugs, QA often includes other areas such as localisation, compliance, and compatibility with a range of devices.<\/p>\n

\n
\"...and

...and taste<\/p><\/div>\n<\/div>\n

Throughout the process, QA is trying to make sure the player can\u2019t get themselves stuck, and no bugs in the game prevent them from completing, or enjoying the game.<\/p>\n

What is Usability and Player Experience testing?<\/h4>\n

Similar to QA, usability and player experience testing involves playing the game. However, this typically wouldn\u2019t be in a similar \u2018farm\u2019 setting. Instead, usability tests often attempt to recreate a typical playing environment, to emulate how a player would typically play the game (required: a sofa, and a 2 litre bottle of pepsi .)<\/p>\n

Player experience is focused on whether a player enjoys what they do in the game, and whether they understand their goals. This can encompass many sub-categories of player experience, such as how is challenge and interest is maintained, why and where players give up, and how they understand the game. Essentially, the aim of player experience testing is to optimise the game so that people want<\/strong> to play the game.<\/p>\n

Meanwhile usability testing blurs slightly more with QA, yet has some fundamental differences. Usability testing is focused on whether the game allows the player to achieve their goals, for example do they notice when something in game changes (such as picking up a new item), or do they understand where they have to go to complete the level. This is different to the \u2018bugs\u2019 that QA discovers, since these are game features, not \u2018mistakes\u2019.<\/p>\n

Why do they differ?<\/h4>\n

Essentially this is the key difference between the two. QA focuses on the unintentional problems with a game, and aims to make the final product as close to the design features documented. A QA success would be a game with no bugs, and with an implementation that matches the designer\u2019s vision.<\/p>\n

\n
\"My

My vision is money... lots of money<\/p><\/div>\n<\/div>\n

In contrast, usability and player experience testing aims to influence and guide the designer\u2019s vision. By involving players, they gain an insight into how the game will be received by its audience, and help the designer create the reaction they\u2019re after. As such, the focus is on the game\u2019s intentional aspects, not its unintentional bugs.<\/p>\n

This leads to different characteristics in the problems found. QA works largely in the edge cases, and tests every hit box, every wall, every enemy and every dialogue choice. Player experience and usability is much more interested in the average experience, to ensure that players \u2018get\u2019 it.<\/p>\n

We can see a shift in the gaming industries perceptions of player experience and usability testing, having been championed by leaders such as Microsoft and Valve, more companies are starting to recruit user experience professionals. With the rise of free social games which require the player to \u2018get\u2019 games quickly, we can see that the field is becoming a key requirement for success, and is becoming a focal point of how games are made. But it\u2019s not QA!<\/p>\n","protected":false},"excerpt":{"rendered":"

As an emerging field, the aims and characteristics of usability and player experience testing can often be unknown or unrecognised within game companies, outside of a few key industry leaders, such as Valve and Bungie. This can often lead to comparisons being made with QA testing, or confusing usability testing as an element of QA. […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[117],"tags":[],"class_list":["post-882","post","type-post","status-publish","format-standard","hentry","category-games-user-research","grve-entry-item","grve-blog-item"],"yoast_head":"\nGames Usability Testing is not QA! - Steve Bromley - User Research<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Games Usability Testing is not QA! - Steve Bromley - User Research\" \/>\n<meta property=\"og:description\" content=\"As an emerging field, the aims and characteristics of usability and player experience testing can often be unknown or unrecognised within game companies, outside of a few key industry leaders, such as Valve and Bungie. This can often lead to comparisons being made with QA testing, or confusing usability testing as an element of QA. […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/\" \/>\n<meta property=\"og:site_name\" content=\"Steve Bromley - User Research\" \/>\n<meta property=\"article:published_time\" content=\"2010-06-01T16:15:36+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-11-06T16:45:02+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/06\/cartridge.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#website\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/\",\"name\":\"Steve Bromley - User Research\",\"description\":\"Usability and User Research for Websites, Software and Games\",\"publisher\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/www.stevebromley.com\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/06\/cartridge.png\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#webpage\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/\",\"name\":\"Games Usability Testing is not QA! - Steve Bromley - User Research\",\"isPartOf\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#primaryimage\"},\"datePublished\":\"2010-06-01T16:15:36+00:00\",\"dateModified\":\"2019-11-06T16:45:02+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/\",\"name\":\"Games Usability Testing is not QA!\"}}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#webpage\"},\"author\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"headline\":\"Games Usability Testing is not QA!\",\"datePublished\":\"2010-06-01T16:15:36+00:00\",\"dateModified\":\"2019-11-06T16:45:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#webpage\"},\"commentCount\":1,\"publisher\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"image\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#primaryimage\"},\"articleSection\":\"Games User Research\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.stevebromley.com\/blog\/2010\/06\/01\/games-usability-testing-is-not-qa\/#respond\"]}]},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\",\"name\":\"Steve Bromley\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4dfbbfc5a00187fd6f5fd405361347b2698a65a866f49de07f9486895b6c7029?s=96&d=mm&r=g\",\"caption\":\"Steve Bromley\"},\"logo\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#personlogo\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/882","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/comments?post=882"}],"version-history":[{"count":6,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/882\/revisions"}],"predecessor-version":[{"id":890,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/882\/revisions\/890"}],"wp:attachment":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/media?parent=882"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/categories?post=882"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/tags?post=882"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}