{"id":978,"date":"2010-07-26T17:45:55","date_gmt":"2010-07-26T16:45:55","guid":{"rendered":"http:\/\/www.stevebromley.com\/blog\/?p=978"},"modified":"2019-11-06T17:45:02","modified_gmt":"2019-11-06T16:45:02","slug":"test-with-real-users-not-your-team","status":"publish","type":"post","link":"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/","title":{"rendered":"Test with real users \u2013 not your team"},"content":{"rendered":"<p>&#8216;Free pizza and coke! Just play our game for an hour\u2019. Sounds like a good deal right? And pretty easy to organise, just pulling kids of the street. It can even be done in the pub, for mobile devices. Even this \u2018free pizza\u2019 recruitment is better than testing your game (or website, or application) with people from within your office. But why?<\/p>\n<p>Game development teams need a constant supply of fresh users to test the \u2018new user\u2019 experience with. I\u2019ve seen teams keep their project secret from their colleagues, not for official reasons, but so their colleagues can be tested as \u2018new users\u2019. Other teams test their games with their HR and secretarial staff, since they are unlikely to have had much exposure to the game.<\/p>\n<p>However it\u2019s a good guideline to never test with your team (unless of course you are building something for them).  It\u2019s understandable why this situation arises \u2013 often budgets are too tight for intensive user testing, forcing teams to perform ad-hoc tests with their colleagues; however this often causes problems further down the line:<\/p>\n<div align=\"center\">\n<div id=\"attachment_982\" style=\"width: 340px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-982\" src=\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/07\/accident_at_work.png\" alt=\"accident at work\" title=\"accident_at_work\" width=\"330\" height=\"227\" class=\"size-full wp-image-982\" srcset=\"https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/07\/accident_at_work.png 330w, https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/07\/accident_at_work-300x206.png 300w\" sizes=\"auto, (max-width: 330px) 100vw, 330px\" \/><p id=\"caption-attachment-982\" class=\"wp-caption-text\">such as ...accidents<\/p><\/div>\n<\/div>\n<h4>Dont test with your team<\/h4>\n<ul>\n<li><strong>Your team are not your users<\/strong> \u2013 Unless you are in a very specialist field, or are developing an internal project like an intranet, it\u2019s unlikely that your team are the same people as your users. And they are very unlikely to act in the same way a typical user would.<\/li>\n<li><strong>Your team know things users wouldn\u2019t<\/strong> \u2013 It\u2019s likely your team will have had prior exposure to your game or application that a new user wouldn\u2019t, and will be bringing prior knowledge to the testing session. This also applies to people who do not work directly on your team. To get a true outside perspective, you need to seek outside users.<\/li>\n<li><strong>Your team know you \u2013 <\/strong>Unlike a stranger, your team are already know you, and (hopefully) like you. Their answers, and interactions will be biased to please you, and tell you what you want to hear based on what they know about your job, the project your working on, or your beliefs (for example, attempting to validate your design choices).<\/li>\n<\/ul>\n<h4>Advantages of testing with real users.<\/h4>\n<p>How people act can often be surprising. If this wasn\u2019t the case, there would be little point in user testing. That\u2019s why it\u2019s extremely important to gather real data, from the people who will actually be using your product. Only real users will approach your product from an authentic \u2018new user\u2019 angle, and give an insight into how your product will be perceived and used.<\/p>\n<p>Getting real users involved with product development will get them engaged with the product. Asking their opinions, and being interested in their experience will make the user feel positive about you, and your product, and will mean they will be more likely to purchase it when it\u2019s ready. In newsrooms, this has been widely known for years \u2013 hence the proliferation of lists of names in local papers.<\/p>\n<p>Most importantly, involving users will get them talking about your product, generating true grass roots \u2018word of mouth\u2019 promotion (hopefully without breaking any NDA\u2019s!). Giving customers an early exposure to your product can build excitement, and market your product for free!<\/p>\n<div align=\"center\">\n<div id=\"attachment_983\" style=\"width: 241px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-983\" src=\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/07\/megaphone.png\" alt=\"megaphone\" title=\"megaphone\" width=\"231\" height=\"330\" class=\"size-full wp-image-983\" srcset=\"https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/07\/megaphone.png 231w, https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/07\/megaphone-210x300.png 210w\" sizes=\"auto, (max-width: 231px) 100vw, 231px\" \/><p id=\"caption-attachment-983\" class=\"wp-caption-text\">saving millions on megaphones<\/p><\/div>\n<\/div>\n<h4>Conclusion<\/h4>\n<p>Finding real users can be cheaper than you think. Not only is it possible to pull people off the street, using the methods suggested above, but new usability testing methods such as <a href=\"http:\/\/www.stevebromley.com\/blog\/2010\/06\/23\/remote-research-book-review\/\">remote user testing<\/a> allow you to find and test real users from the comfort of your office, for very low cost.  These days there\u2019s almost no excuse not to test with real users, and it can be just as easy as testing with your team, with much more rewarding returns.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8216;Free pizza and coke! Just play our game for an hour\u2019. Sounds like a good deal right? And pretty easy to organise, just pulling kids of the street. It can even be done in the pub, for mobile devices. Even this \u2018free pizza\u2019 recruitment is better than testing your game (or website, or application) with [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[118],"tags":[],"class_list":["post-978","post","type-post","status-publish","format-standard","hentry","category-user-research","grve-entry-item","grve-blog-item"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v15.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Test with real users \u2013 not your team - Steve Bromley - User Research<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Test with real users \u2013 not your team - Steve Bromley - User Research\" \/>\n<meta property=\"og:description\" content=\"&#8216;Free pizza and coke! Just play our game for an hour\u2019. Sounds like a good deal right? And pretty easy to organise, just pulling kids of the street. It can even be done in the pub, for mobile devices. Even this \u2018free pizza\u2019 recruitment is better than testing your game (or website, or application) with [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/\" \/>\n<meta property=\"og:site_name\" content=\"Steve Bromley - User Research\" \/>\n<meta property=\"article:published_time\" content=\"2010-07-26T16:45:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-11-06T16:45:02+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/07\/accident_at_work.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#website\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/\",\"name\":\"Steve Bromley - User Research\",\"description\":\"Usability and User Research for Websites, Software and Games\",\"publisher\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/www.stevebromley.com\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2010\/07\/accident_at_work.png\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#webpage\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/\",\"name\":\"Test with real users \\u2013 not your team - Steve Bromley - User Research\",\"isPartOf\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#primaryimage\"},\"datePublished\":\"2010-07-26T16:45:55+00:00\",\"dateModified\":\"2019-11-06T16:45:02+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/\",\"name\":\"Test with real users \\u2013 not your team\"}}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#webpage\"},\"author\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"headline\":\"Test with real users \\u2013 not your team\",\"datePublished\":\"2010-07-26T16:45:55+00:00\",\"dateModified\":\"2019-11-06T16:45:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#webpage\"},\"commentCount\":2,\"publisher\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"image\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#primaryimage\"},\"articleSection\":\"User Research\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.stevebromley.com\/blog\/2010\/07\/26\/test-with-real-users-not-your-team\/#respond\"]}]},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\",\"name\":\"Steve Bromley\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4dfbbfc5a00187fd6f5fd405361347b2698a65a866f49de07f9486895b6c7029?s=96&d=mm&r=g\",\"caption\":\"Steve Bromley\"},\"logo\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#personlogo\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/978","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/comments?post=978"}],"version-history":[{"count":9,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/978\/revisions"}],"predecessor-version":[{"id":2369,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/978\/revisions\/2369"}],"wp:attachment":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/media?parent=978"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/categories?post=978"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/tags?post=978"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}