{"id":2598,"date":"2020-10-01T09:10:23","date_gmt":"2020-10-01T08:10:23","guid":{"rendered":"http:\/\/www.stevebromley.com\/blog\/?p=2598"},"modified":"2020-10-05T09:31:35","modified_gmt":"2020-10-05T08:31:35","slug":"5-excuses-for-not-running-user-research-and-how-to-overcome-them","status":"publish","type":"post","link":"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/","title":{"rendered":"5 excuses for not running user research, and how to overcome them"},"content":{"rendered":"<p><b>Some common\u00a0reasons teams use to avoid running research studies, why they are misguided, and some tactics for overcoming them.\u00a0\u00a0<\/b><\/p>\n<p><span style=\"font-weight: 400;\">User research\u00a0studies\u00a0uncover information about users or products which helps teams make better decisions.\u00a0This is\u00a0rarely not useful. However, sometimes product and design teams\u00a0can be reluctant to run user research. Sometimes this is for very human reasons &#8211; people could assume that discovering issues could reflect on the quality of their work. This is understandable and requires time and empathy to help colleagues overcome.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Other reasons for reluctance can be due to not understanding how research can help. In this article, we\u2019ll look at some examples where this might occur, and some techniques for helping educate people and overcome these fears.<\/span><\/p>\n<div id=\"attachment_2602\" style=\"width: 3530px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-2602\" class=\"size-full wp-image-2602\" src=\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/tonik-U0wwiY6nRGA-unsplash.jpg\" alt=\"Don't Panic written on a board\" width=\"3520\" height=\"2601\" srcset=\"https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/tonik-U0wwiY6nRGA-unsplash.jpg 3520w, https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/tonik-U0wwiY6nRGA-unsplash-300x222.jpg 300w, https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/tonik-U0wwiY6nRGA-unsplash-768x567.jpg 768w, https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/tonik-U0wwiY6nRGA-unsplash-1024x757.jpg 1024w\" sizes=\"auto, (max-width: 3520px) 100vw, 3520px\" \/><p id=\"caption-attachment-2602\" class=\"wp-caption-text\">Helping teams learn about user research will help overcome their fears<\/p><\/div>\n<h2><span style=\"font-weight: 400;\">\u201cIt\u2019s not ready to test yet\u201d<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Some teams assume that software needs to be nearly done before it\u2019s worth running user research studies. This belief relies on teams believing that any issue can be fixed with \u2018tweaks\u2019, and that there is no value in research until something representative of the final product exists. However, it\u2019s misguided for a couple of reasons.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The first problem is that waiting until it\u2019s \u2018ready\u2019 usually means waiting until it\u2019s too late to fix issues. The cost of making changes increases over time &#8211; it\u2019s much cheaper to change an \u2018idea\u2019 than an almost completed app. If the core idea of the app is misguided (and it frequently is), learning that just before launch is much too late. Early research studies, looking at how users perform similar tasks, and what\u2019s hard for them currently, can help make sure the idea itself is worth pursuing further, without wasting expensive development time.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another problem with waiting to test is that people also become more invested in their idea the longer they spend with it. Putting weeks of development work into a feature, only to be told it needs to change, can be hard to hear. This causes people to dismiss research findings and will reduce the impact of research studies.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Teams also assume that researchers can\u2019t work around bits that \u2018aren\u2019t ready\u2019 yet. However, combining carefully scoped research objectives, and an understanding of the intended experience, allows researchers to recreate the missing parts of the experience where required, allowing the study to go ahead before everything is complete.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To overcome this misconception, start with education about some of the above points, so that team members are aware of the risks of waiting too long. Time spent speaking with the team to understand their current priorities can also help identify relevant research objectives at every stage of development &#8211; a researcher can help suggest potential objectives that the team wouldn\u2019t have thought of independently. Strong communication with development teams will identify high-impact research objectives that can be addressed immediately, and which other objective moderators will need to mock-up or work around in their study designs.<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">\u201cUser research is too expensive\u201d<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">It is true that it costs money to run user research studies. Finding the right participants takes time, and incentivising them to actually turn up requires giving them money. Similarly, inviting team members to view sessions is costing the company time, because it takes team member\u2019s time.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">As user researchers, we believe that these activities are saving the company money later down the line. This can be hard to measure &#8211; although being hard to measure doesn\u2019t mean it doesn\u2019t exist. These studies help save money by allowing teams to get to the best implementation of their idea sooner, and reduce the time it takes to build a useful and usable product. Acting on research studies also helps earn the company money by increasing customer retention. I touched on some techniques for measuring the Return On Investment (ROI) of research in a <\/span><a href=\"https:\/\/medium.com\/leading-research\/beyond-usability-testing-maturing-a-research-team-94e7949087cf\"><span style=\"font-weight: 400;\">previous article for the Leading Research community.<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400;\">Working out the ROI of user research studies for early, low commitment studies can help build confidence that research is useful and saves money. Researchers should work out which metrics are important to their company &#8211; finding more customers, keeping the customers they have, releasing sooner &#8211; and describe how their studies are moving these metrics. This makes a strong case for the financial benefit of running research studies.\u00a0<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">\u201dWe know what\u2019s wrong already\u201d<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Most of the time teams already know some things that are wrong with their software. Prioritisation and deadlines mean that many known issues might have to be ignored. This can cause teams to worry that they will learn nothing new from a research study &#8211; it\u2019ll just tell them the issues they are already aware of, and not be useful.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To deal with this, the first step is to understand why the known issues aren\u2019t being fixed. Is it a lack of evidence, which research can help with? Or is it internal politics, such as friction between teams? Uncovering this allows the value of running a research study to be decided, and research objectives to be prioritised.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Even if some problems are already known, a research study can still provide value. Understanding the impact of the issue on users will help inform the priority for the problem. Understanding a user&#8217;s existing experience may also help inspire better fixes to known problems with fewer iterations needed, by bringing \u201chow it works\u201d and \u201chow people think it works\u201d into closer alignment earlier.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another aspect to consider when navigating these conversations is defining appropriate research objectives. How will you work with the team to decide what the next study should learn? These should be informed by upcoming decisions the team has to make, and through setting appropriate objectives (and ignoring ones that are related to already understood issues), a research study can help discover new and interesting problems rather than things the team already knows.<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">\u201cUser research takes too long\u201d<\/span><\/h2>\n<div id=\"attachment_2600\" style=\"width: 4192px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-2600\" class=\"size-full wp-image-2600\" src=\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/brad-neathery-nPy0X4xew60-unsplash.jpg\" alt=\"Laptop user looking at watch\" width=\"4182\" height=\"2790\" srcset=\"https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/brad-neathery-nPy0X4xew60-unsplash.jpg 4182w, https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/brad-neathery-nPy0X4xew60-unsplash-300x200.jpg 300w, https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/brad-neathery-nPy0X4xew60-unsplash-768x512.jpg 768w, https:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/brad-neathery-nPy0X4xew60-unsplash-1024x683.jpg 1024w\" sizes=\"auto, (max-width: 4182px) 100vw, 4182px\" \/><p id=\"caption-attachment-2600\" class=\"wp-caption-text\">Waiting for research findings<\/p><\/div>\n<p><span style=\"font-weight: 400;\">Research studies take time to run. To reliably answer research objectives requires users, and getting hold of the right kind of user can take a week or more. This can make teams worried that they will learn things too late to address them and that they will have moved onto other priorities, making the study pointless.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For researchers the actual data collection, analysis, and debriefing process can be reasonably quick &#8211; <\/span><a href=\"https:\/\/www.stevebromley.com\/book\/\"><span style=\"font-weight: 400;\">in the book Building User Research Teams I talk about how to do this in two days<\/span><\/a><span style=\"font-weight: 400;\">. The challenge is therefore having appropriate warning to schedule and plan the right study for the team\u2019s current priorities. Running the study itself is reasonably quick and fits into a team\u2019s schedule easily.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Overcoming this is again a communications issue, and requires a researcher to anticipate what the team will want to know in one to two weeks&#8217; time. This can be done by attending the team\u2019s planning rituals, meeting with product managers, and keeping track of what the development team is up to while recruitment is occurring to adjust objectives closer to the time. Close collaboration with teams will lead to running studies exactly when they are needed.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Much like with the financial cost of research, running user research studies is actually saving development time, by identifying problems earlier in development so they can be prioritised and resolved promptly. It\u2019s much harder for a development team to react to problems closer to launch, and leads to more redundant development work being thrown away. User research through development speeds up the time it takes to reach a high-quality product.\u00a0<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">\u201cUser research is just people\u2019s opinions, not real data like analytics\u201d<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Teams new to working with user researchers, or who have worked with disappointing researchers before may not immediately recognise the value of qualitative research. Analytics and A\/B testing create trustworthy looking numbers and numerical proof of impact &#8211; which makes it easy to measure and justify. In contrast, qualitative research studies give rich information that requires analysis to indicate potential product directions or inspire solutions but is harder to turn into numbers. However as we\u2019ve seen, not everything that matters can be measured.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">When it comes to actually deciding what to do, qualitative research findings are hugely valuable and give a much stronger steer about \u201cwhat should we do about this problem\u201d than quantitative research. Discovering \u201c39% of people click on this page vs 20% on this page\u201d doesn\u2019t give rich hints about how to increase the number of people who click on that page, or whether that page is achieving its goals. In contrast, understanding \u201dwhat were people trying to do when they arrived on the page\u201d and \u201cdid they manage to do it\u201d, and \u201cwhy\/why not\u201d will inspire many informed ideas about how to increase that 39% number (or even if increasing that number is the right thing to do).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This lack of trust in qualitative data can also result from a misunderstanding about what a user researcher is doing when they talk to or observe, people. A researcher should not just be reporting what people say. The user\u2019s thoughts and behaviour are probed so that the researcher can share the user\u2019s understanding of the situation. This insight allows sensible decisions to be made about how to change what users think or do. This understanding, combined with a quantitative understanding of how representative each behaviour is, can be very powerful for making good product decisions.\u00a0<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">When you shouldn\u2019t run\u00a0a research study<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">There are times when it truly isn\u2019t appropriate to run research studies. Sometimes the decision has already been made, and there won&#8217;t be a chance to react to the findings of a study. Other times it isn\u2019t evidence that is informing decision making, and research findings will be ignored. I\u2019ve written a bit about how to recognise and overcome those situations in the book <\/span><a href=\"https:\/\/www.stevebromley.com\/book\/\"><span style=\"font-weight: 400;\">Building User Research Teams<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Challenging teams who are reluctant to run research is a key part of increasing people\u2019s awareness of the ways in which research studies can help, and helps raise the research maturity of a company.\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Some common reasons teams use to avoid running research studies, why they are misguided, and some tactics for overcoming them.  <\/p>\n<p>Misunderstandings about qualitative research can put teams off running research studies. In this article, we\u2019ll look at some examples where this might occur, and some techniques for helping educate people and overcome their fears about research.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[118],"tags":[],"class_list":["post-2598","post","type-post","status-publish","format-standard","hentry","category-user-research","grve-entry-item","grve-blog-item"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v15.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>5 excuses for not running user research, and how to overcome them - Steve Bromley - User Research<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"5 excuses for not running user research, and how to overcome them - Steve Bromley - User Research\" \/>\n<meta property=\"og:description\" content=\"Some common reasons teams use to avoid running research studies, why they are misguided, and some tactics for overcoming them.   Misunderstandings about qualitative research can put teams off running research studies. In this article, we\u2019ll look at some examples where this might occur, and some techniques for helping educate people and overcome their fears about research.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/\" \/>\n<meta property=\"og:site_name\" content=\"Steve Bromley - User Research\" \/>\n<meta property=\"article:published_time\" content=\"2020-10-01T08:10:23+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-10-05T08:31:35+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/tonik-U0wwiY6nRGA-unsplash.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#website\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/\",\"name\":\"Steve Bromley - User Research\",\"description\":\"Usability and User Research for Websites, Software and Games\",\"publisher\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/www.stevebromley.com\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"http:\/\/www.stevebromley.com\/blog\/wp-content\/uploads\/2020\/09\/tonik-U0wwiY6nRGA-unsplash.jpg\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#webpage\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/\",\"name\":\"5 excuses for not running user research, and how to overcome them - Steve Bromley - User Research\",\"isPartOf\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#primaryimage\"},\"datePublished\":\"2020-10-01T08:10:23+00:00\",\"dateModified\":\"2020-10-05T08:31:35+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/\",\"url\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/\",\"name\":\"5 excuses for not running user research, and how to overcome them\"}}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#webpage\"},\"author\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"headline\":\"5 excuses for not running user research, and how to overcome them\",\"datePublished\":\"2020-10-01T08:10:23+00:00\",\"dateModified\":\"2020-10-05T08:31:35+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#webpage\"},\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\"},\"image\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#primaryimage\"},\"articleSection\":\"User Research\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.stevebromley.com\/blog\/2020\/10\/01\/5-excuses-for-not-running-user-research-and-how-to-overcome-them\/#respond\"]}]},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#\/schema\/person\/9c0be0bbd079c086677d422d1fd9c8c7\",\"name\":\"Steve Bromley\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4dfbbfc5a00187fd6f5fd405361347b2698a65a866f49de07f9486895b6c7029?s=96&d=mm&r=g\",\"caption\":\"Steve Bromley\"},\"logo\":{\"@id\":\"https:\/\/www.stevebromley.com\/blog\/#personlogo\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/2598","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/comments?post=2598"}],"version-history":[{"count":6,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/2598\/revisions"}],"predecessor-version":[{"id":2608,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/posts\/2598\/revisions\/2608"}],"wp:attachment":[{"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/media?parent=2598"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/categories?post=2598"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.stevebromley.com\/blog\/wp-json\/wp\/v2\/tags?post=2598"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}