Ask the Right Questions
The following are some core best practices when writing usability test questions. They focus on eliminating bias and gaining real insight into how users interact with your design.
Understand the Areas of the Product That Need Answers
In order to ask the right questions of your participants, you first have to know what questions the business needs answered. The right questions aren’t just any questions, they are questions that will help you and your team move forward. So your first question should actually be one you ask yourself: “What do I want to learn?” In addition to helping you figure out outcomes, your answer can also help you decide how to use the results.
Don't Ask Leading Questions
Though it’s tempting to suggest answers to your users, do your best not to lead the conversation in a particular direction. Don’t influence the user, because you need open, truthful answers to improve your design. Leading questions defeat that purpose. For example, ask “How much would this product cost you? How easy or difficult was it to find that information?” rather than “How easy was it to find the pricing page?”
Ask Open-Ended Questions
Open-ended questions enable you to “give your test participant minimal explanation about how to perform the task or answer the question,” User Testing Blog says. That way, you can observe as participants navigate coming up with a solution on their own. Open-ended questions can’t be answered with a simple “yes” or “no.” They’re beneficial because they require users to provide an explanation, giving you even more insight into their thought processes. In general, they help you see how your user thinks, as well as noting typical user behavior.
Break up Complex Concepts into Multiple Questions
When you are covering complicated or overly technical aspects of your design, break up questions so the user doesn’t get overwhelmed. Instead, “break concepts up when you’re asking the questions and put them back together when you’re analyzing the results,” User Testing Blog says.
Don't Use Jargon
Technical terms don’t resonate with most users, so you’ll want to avoid them as much as possible. When you have to include them, it’s best to define terms within the question itself so that your user has enough context.
Ask "Show Me" Questions, Not Just "Tell Me" Questions
This can give you valuable insight into how a user actually navigates your site. Rather than solely asking your participants to explain their choices to you, watching them move around your site in real time can show you functionalities that don’t work well or aren’t as intuitive as they could be. One example is asking, “Show me where you might look if you wanted a new car that could seat six people.”
Don't Answer Participants' Questions
Instead, ask them questions back. This is because “introducing new information or giving unintentional clues can bias the research results and even invalidate that session’s data,” the Nielsen Norman Group says. Instead, say things like, “That’s a good question, what do you think?” or “I’m not sure, where might we look to find out?”
Don't Ask Participants for Solutions
The best user testing questions ask participants what they were looking for and what they expected to happen. Sometimes participants have trouble articulating what they found confusing. It’s the responsibility of the moderator to understand what was confusing them. He or she can typically find the source of participants’ confusion by asking them why they did something and what they thought would happen.
Lesley University’s online BS in Design for User Experience program prepares students to create meaningful, people-first design. The curriculum focuses on graphic design principles and collaborative learning, teaching students to design intuitive experiences across an ecosystem of products, services, and systems. You’ll learn to work through all aspects of the design process, from testing to product launch.
Related Articles & Stories
Read more about our students, faculty and alumni.