Use Case Part 1: How to design user surveys
📝

Use Case Part 1: How to design user surveys

Join the Weekly Digest
image

🤓 Why?

As you start thinking of rolling out use cases in your organization, you might think about choosing a use case based solely on your assumptions. Though it is tempting, we recommend that you take time to prepare and choose the use case to prioritize based on solid research. After all, well-begun is half-done! One great way to research your end users is to send them a user survey.

User surveys are an effective tool that helps you broadly understand the end users in the organization. They provide you with the ability to zoom in on the areas that stand out and dig deeper into them by conducting further 1:1 with representative users.

🌟 Best practices for designing a user survey

1️⃣ Define a clear goal for the survey

What does a clear goal look like? Let’s use an example. Say you want to understand different end users in your organization. Instead of a goal like “I want to better understand end users in the organization”, your goal should be something like “I want to better understand the data-related challenges of end users in the organization".

You can get more specific and ask, what are the broad categories of users in the organization and what are the key factors that lead to this segmentation? Is it the tools they are leveraging, the data-related activities they perform, the time they spend on those activities or the teams they collaborate with, etc?

💡
Once you’ve come up with your goal, you can use it as a reference to prioritize the top questions you want to ask.

2️⃣ Focus on using closed-ended questions

Closed-ended questions are ones that use pre-populated answer choices for the respondent to choose from—like multiple choice or checkbox questions. They are a great way to ensure that respondents interpret questions the same way.

Open-ended questions, on the other hand, ask the respondent for feedback in their own words. They allow the greatest variety of responses but are time-consuming to ask and require a lot of work to analyze. Respondents are also likely to skip open-ended questions, so try to only include 1-2 of them in your survey.

Example of a closed-ended question
Example of a closed-ended question
💡
Closed-ended questions are not only easier for respondents to answer but also provide you with quantitative data to use in your analysis.

3️⃣ Keep your answer choices balanced

Remember that since you are asking respondents to choose from a few options, it is crucial that you are not biasing your options.

For example, let’s say our prompt is, “How do you find the process of locating the right data?”

Here’s how a set of unbalanced answer choices (that lean towards being too positive) can look for that question:

a. Very easy

b. Easy

c. Neither easy nor complex

And here’s how they’d look once balanced:

a. Very easy

b. Easy

c. Neither easy nor complex

d. Complex

e. Extremely complex

💡
Using answer choices that lean a certain way can result in respondents providing inauthentic feedback.

4️⃣ Don't ask double-barreled questions

Double-barreled questions are when you ask for feedback on two separate things within a single question.

Here’s an example:

“How do you find the process of locating the right data and understanding the context behind it?”

How would the respondent answer this question? Should they address the issue of locating the right data, or should they consider the issue of understanding the data? These questions confuse respondents and drop the quality of your survey.

Fixing a double-barreled question
Fixing a double-barreled question
💡
The best way to fix a double-barreled question is by either choosing one thing to ask or by breaking the question up into 2 separate ones.

5️⃣ Don’t let your survey get too long

You probably know from your own experience that we tend to abandon long surveys. The same principle applies when you are designing a survey for another user. Don't create a long questionnaire. Your reward for keeping it short (less than 5 minutes) will be a higher organization-wide completion rate.

Another good way to increase completion rate is to schedule 10 minutes in your team meeting for everyone to fill out the survey while they are on the call. This has two benefits — respondents get an opportunity to ask clarifying questions, and you end up with enough responses for analysis.

💡
Remember, a user survey is a way to understand broader problems, not an opportunity for a deep dive into specifics. Use them to identify folks you can schedule user interviews with, and then have those detailed discussions.

To help you get started, we have created a user survey template. Feel free to customize it for your goals. If you have any questions or want to know more, you can always reach out to your Data Success Manager 💙

📔 Resources

🔗 Related reads

🎯
Designing a high value use case for an organization-wide roll-out