2. User Research

Surveys And Metrics — Quiz

Test your understanding of surveys and metrics with 5 practice questions.

Practice Questions

Question 1

When conducting A/B testing for a product feature, a product designer observes a p-value of $0.03$. If the significance level ($\alpha$) is set at $0.05$, what is the appropriate conclusion?

Question 2

A product team is analyzing user feedback from a survey where users rated their satisfaction on a scale of 1 to 5. They want to understand the central tendency of these ratings, but are concerned about the influence of a few extremely low ratings. Which measure of central tendency would be most robust to these outliers?

Question 3

To assess the product-market fit of a new application, a product manager uses the 'Sean Ellis Test' by asking users how they would feel if they could no longer use the product. If $35\%$ of users respond 'very disappointed', what does this typically indicate?

Question 4

A product team is designing a survey to gather feedback on a complex new feature. To ensure comprehensive and nuanced responses, they decide to use open-ended questions. What is the primary challenge associated with analyzing data from open-ended questions in large-scale surveys?

Question 5

In a survey designed to measure user satisfaction, a product team collects data using a 7-point Likert scale. They want to visualize the distribution of responses for a specific question. Which type of chart would be most appropriate for this ordinal data?