Overview of case study for usability tests with Userpilot<\/h2>\n\n- Challenge<\/strong>: Lisa, our UX researcher, found it difficult to recruit participants for usability tests<\/a> via email since B2B users are busy individuals with cluttered inboxes. This challenge was critical because it could lead to inaccurate product decisions, delays in development, and missed opportunities in a competitive industry.<\/li>\n
- Solution<\/strong>: Lisa realized she needed a channel with less distraction and more engagement, leading her to choose our own product for inviting users. Using Userpilot\u2019s survey functionality, Lisa created an interview invite survey and triggered it to the right user segment inside Userpilot.<\/li>\n
- Results<\/strong>: In only a few days, Lisa was able to recruit 19 participants when she only expected to speak to 5 users. Hence, achieving four times better results than expected by inviting users<\/a> inside the app.<\/li>\n
- If you, too, are looking to streamline your user research process, there is no tool better than Userpilot. It enables you to collect customer feedback in-app, analyze user behavior using multiple reports, and conduct product experiments. Book a demo<\/a> to learn more.<\/li>\n<\/ul>\n
Challenge: Recruiting usability test participants<\/h2>\n
After leaving Microsoft for Userpilot, Lisa set out to conduct usability test interviews<\/a> to learn how users utilized our popular customer segmentation feature. She began to recruit participants by emailing them but much to Lisa\u2019s dismay, all she got was crickets.<\/p>\n![\"usability-test-recruitment-email\"](\"https:\/\/images.storychief.com\/account_6827\/usability-test-recruitment-email_b2c9b5fa66fc38879baa016e992662cd_800.png\")
<\/picture>Recruiting usability test participants via email.<\/figcaption><\/figure>\nThis was not a problem in Microsoft because when you have millions of B2C users, it\u2019s far easier to recruit participants<\/a> with a $100 voucher incentive. There are even websites created specifically for enlisting user interview participants, cutting the efforts of researchers in half.<\/p>\n![\"tool-for-recruiting-interview-participants\"](\"https:\/\/images.storychief.com\/account_6827\/tool-for-recruiting-interview-participants_6834c52cebdf54dac8f468bc62abcdff_800.png\")
<\/picture>A website for recruiting interview participants.<\/figcaption><\/figure>\nHowever, as Lisa experienced, this was not the case in the B2B space. B2B users, especially on the executive level, are busy individuals with even busier inboxes filled with spam, cold emails<\/a>, meeting invites, and whatnot.<\/p>\nThis left Lisa with a challenge because when you\u2019re working in a competitive industry and a high-growth startup, you can\u2019t afford to lose time getting users on board with your UX research<\/a> efforts.<\/p>\nWhat\u2019s the business impact of this challenge for SaaS teams?<\/h3>\n
Being unable to recruit participants for usability testing is a problem no UX researcher<\/a> would want to face.<\/p>\nUsability tests are used to validate design decisions, monitor ease of use, and identify areas for improvement<\/a>. But if you\u2019re unable to gather a decent pool of participants, you bear the risk of your decisions being inaccurate, which may lead to costly changes post-launch.<\/p>\nBut even before that, difficulty in enlisting participants can lead to delays in conducting usability tests, which can prolong product development<\/a> timelines. Not only will this impact time-to-market, but it will also result in missed opportunities if your competitors beat you to the finish line.<\/p>\nSolution: Finding a different channel to recruit test participants<\/h2>\n
This delay in recruiting participants made one thing clear – there was a need for a better channel, one with fewer distractions and greater engagement. For Lisa, the solution became evident: leveraging our own product, i.e., Userpilot<\/a>, as the channel.<\/p>\nUsing our product to recruit interview participants was a logical choice. Unlike other channels with spam messages or advertisements, our app offered a focused environment where participants’ attention wasn\u2019t divided. And, since our product was already integral to their work, it served as a familiar channel for engagement<\/a>.<\/p>\nLisa then used Userpilot\u2019s in-app survey<\/a> functionality to create a close-ended survey in mere minutes to recruit participants.<\/p>\n![\"user-testing-invite-survey\"](\"https:\/\/images.storychief.com\/account_6827\/user-testing-invite-survey_22a17210a21393951ffc3814c248fb89_800.png\")
<\/picture>In-app survey created in Userpilot<\/a> to recruit test participants.<\/figcaption><\/figure>\nThe best part? Lisa was able to send this interview invite to the right user segment<\/a> – those users who had already previously used the segmentation feature.<\/p>\nShe didn\u2019t have to use another tool for this purpose. This was done no-code, right inside Userpilot<\/a>.<\/p>\n![\"survey-segmentation-in-userpilot\"](\"https:\/\/images.storychief.com\/account_6827\/survey-segmentation-in-userpilot_5ab2f30b7699358607fd82c38f868e4e_800.png\")
<\/picture>Survey segmentation in Userpilot<\/a>.<\/figcaption><\/figure>\nResults: 4X more response rates for in-app invitations<\/h2>\n
So was Lisa\u2019s decision to recruit participants in-app any fruitful?<\/p>\n
In just a few days, Lisa was able to recruit 19 participants when she only wanted to speak to 5 people. She witnessed 4x better results than what she expected by inviting users inside the app<\/a> (using Userpilot, of course).<\/p>\n![\"results-of-usability-test-survey\"](\"https:\/\/images.storychief.com\/account_6827\/results-of-usability-test-survey_4ba0874a9558ff8dfcbe1d369de5c926_800.png\")
<\/picture>Results of the interview invitation survey.<\/figcaption><\/figure>\nThis high response rate<\/a> is not just limited to interview invite surveys. The team also launched a feature feedback survey and<\/a> got 55 quality responses in just 2 days.<\/p>\n![\"feedback-feature-survey-results\"](\"https:\/\/images.storychief.com\/account_6827\/feedback-feature-survey-results_d2f8d6279cc1adbc459007dd86446ee1_800.png\")
<\/picture>Results of the feature feedback survey.<\/figcaption><\/figure>\nHow to perform user research with Userpilot?<\/h2>\n
If you want to conduct user research seamlessly like Lisa, Userpilot is the solution you need. Here are a few features that will streamline your UX research efforts.<\/p>\n
Collect customer feedback through surveys<\/h3>\n
We\u2019ve already touched upon Userpilot\u2019s survey functionality but that was just the tip of the iceberg. There are several survey templates you can customize for different purposes: market research, product-market fit<\/a>, NPS – you name it!<\/p>\nYou can trigger these surveys for relevant segments and choose where and when to display them. If you have a diverse audience, you can localize these surveys<\/a> by translating them into different languages.<\/p>\nAnd if you still want to send email surveys (even though we proved why you shouldn\u2019t), you can integrate Userpilot with HubSpot<\/a> and Salesforce<\/a> to send emails to highly targeted audiences.<\/p>\n![\"userpilot-survey-templates\"](\"https:\/\/d37oebn0w9ir6a.cloudfront.net\/account_6827\/userpilot-survey-templates_217ce80c3b3dc3c63c4a6f4316efcddb.gif\")
<\/picture>Userpilot<\/a> survey templates.<\/figcaption><\/figure>\nAnalyze customer behavior data over time<\/h3>\n
Analyzing user behavior can provide valuable insights, especially if some users struggle to articulate their feedback effectively.<\/p>\n
Here are a few analytics features <\/a>Userpilot offers that you can use and for which purposes:<\/p>\n\n- Funnel analysis – to identify conversion and friction points<\/a> across the customer journey.<\/li>\n
- Trend analysis<\/a> – to monitor how user behavior patterns vary over time.<\/li>\n
- Cohort retention analysis<\/a> – to track retention rates of similar user cohorts<\/a>.<\/li>\n
- Path analysis – to discover the shortest path to value<\/a>.<\/li>\n
- Custom event tracking<\/a> – to track multiple user actions as if they were one.<\/li>\n
- Analytics dashboards – to monitor important metrics and reports in visual dashboards<\/a>.<\/li>\n<\/ul>\n
![\"trend-analysis-in-userpilot\"](\"https:\/\/images.storychief.com\/account_6827\/trend-analysis-in-userpilot_219928f7881d0fe8cbb6cecf498a417e_800.png\")
<\/picture>Trend analysis in Userpilot<\/a>.<\/figcaption><\/figure>\nConduct A\/B testing for product experiments<\/h3>\n
With A\/B testing in Userpilot, you can ascertain how product changes impact user behavior and preferences. You can compare different variants of in-app flows<\/a> to determine which version performs better and for which customer segment.<\/p>\nYou can also conduct multivariate tests<\/a> to compare more than two in-app flows.<\/p>\n![\"ab-testing-in-userpilot-copy\"](\"https:\/\/images.storychief.com\/account_6827\/ab-testing-in-userpilot-copy_b3d8ae92bd23b71193ee20ba29564442_800.png\")
<\/picture>A\/B testing in Userpilot<\/a>.<\/figcaption><\/figure>\nConclusion<\/h2>\n
This example showed us that there is no better channel for collecting customer feedback than in-app as it offers a less cluttered environment and enables you to reach your most active users.<\/p>\n
If you want to streamline your feedback efforts in-app, there is no better tool than Userpilot. Book a demo<\/a> to see it in action.<\/p>\n
Challenge: Recruiting usability test participants<\/h2>\n
After leaving Microsoft for Userpilot, Lisa set out to conduct usability test interviews<\/a> to learn how users utilized our popular customer segmentation feature. She began to recruit participants by emailing them but much to Lisa\u2019s dismay, all she got was crickets.<\/p>\n This was not a problem in Microsoft because when you have millions of B2C users, it\u2019s far easier to recruit participants<\/a> with a $100 voucher incentive. There are even websites created specifically for enlisting user interview participants, cutting the efforts of researchers in half.<\/p>\n However, as Lisa experienced, this was not the case in the B2B space. B2B users, especially on the executive level, are busy individuals with even busier inboxes filled with spam, cold emails<\/a>, meeting invites, and whatnot.<\/p>\n This left Lisa with a challenge because when you\u2019re working in a competitive industry and a high-growth startup, you can\u2019t afford to lose time getting users on board with your UX research<\/a> efforts.<\/p>\n Being unable to recruit participants for usability testing is a problem no UX researcher<\/a> would want to face.<\/p>\n Usability tests are used to validate design decisions, monitor ease of use, and identify areas for improvement<\/a>. But if you\u2019re unable to gather a decent pool of participants, you bear the risk of your decisions being inaccurate, which may lead to costly changes post-launch.<\/p>\n But even before that, difficulty in enlisting participants can lead to delays in conducting usability tests, which can prolong product development<\/a> timelines. Not only will this impact time-to-market, but it will also result in missed opportunities if your competitors beat you to the finish line.<\/p>\n This delay in recruiting participants made one thing clear – there was a need for a better channel, one with fewer distractions and greater engagement. For Lisa, the solution became evident: leveraging our own product, i.e., Userpilot<\/a>, as the channel.<\/p>\n Using our product to recruit interview participants was a logical choice. Unlike other channels with spam messages or advertisements, our app offered a focused environment where participants’ attention wasn\u2019t divided. And, since our product was already integral to their work, it served as a familiar channel for engagement<\/a>.<\/p>\n Lisa then used Userpilot\u2019s in-app survey<\/a> functionality to create a close-ended survey in mere minutes to recruit participants.<\/p>\n The best part? Lisa was able to send this interview invite to the right user segment<\/a> – those users who had already previously used the segmentation feature.<\/p>\n She didn\u2019t have to use another tool for this purpose. This was done no-code, right inside Userpilot<\/a>.<\/p>\n So was Lisa\u2019s decision to recruit participants in-app any fruitful?<\/p>\n In just a few days, Lisa was able to recruit 19 participants when she only wanted to speak to 5 people. She witnessed 4x better results than what she expected by inviting users inside the app<\/a> (using Userpilot, of course).<\/p>\n This high response rate<\/a> is not just limited to interview invite surveys. The team also launched a feature feedback survey and<\/a> got 55 quality responses in just 2 days.<\/p>\n If you want to conduct user research seamlessly like Lisa, Userpilot is the solution you need. Here are a few features that will streamline your UX research efforts.<\/p>\n We\u2019ve already touched upon Userpilot\u2019s survey functionality but that was just the tip of the iceberg. There are several survey templates you can customize for different purposes: market research, product-market fit<\/a>, NPS – you name it!<\/p>\n You can trigger these surveys for relevant segments and choose where and when to display them. If you have a diverse audience, you can localize these surveys<\/a> by translating them into different languages.<\/p>\n And if you still want to send email surveys (even though we proved why you shouldn\u2019t), you can integrate Userpilot with HubSpot<\/a> and Salesforce<\/a> to send emails to highly targeted audiences.<\/p>\n Analyzing user behavior can provide valuable insights, especially if some users struggle to articulate their feedback effectively.<\/p>\n Here are a few analytics features <\/a>Userpilot offers that you can use and for which purposes:<\/p>\n With A\/B testing in Userpilot, you can ascertain how product changes impact user behavior and preferences. You can compare different variants of in-app flows<\/a> to determine which version performs better and for which customer segment.<\/p>\n You can also conduct multivariate tests<\/a> to compare more than two in-app flows.<\/p>\n This example showed us that there is no better channel for collecting customer feedback than in-app as it offers a less cluttered environment and enables you to reach your most active users.<\/p>\n If you want to streamline your feedback efforts in-app, there is no better tool than Userpilot. Book a demo<\/a> to see it in action.<\/p>\n![\"usability-test-recruitment-email\"](\"https:\/\/images.storychief.com\/account_6827\/usability-test-recruitment-email_b2c9b5fa66fc38879baa016e992662cd_800.png)
<\/picture>![\"tool-for-recruiting-interview-participants\"](\"https:\/\/images.storychief.com\/account_6827\/tool-for-recruiting-interview-participants_6834c52cebdf54dac8f468bc62abcdff_800.png)
<\/picture>What\u2019s the business impact of this challenge for SaaS teams?<\/h3>\n
Solution: Finding a different channel to recruit test participants<\/h2>\n
![\"user-testing-invite-survey\"](\"https:\/\/images.storychief.com\/account_6827\/user-testing-invite-survey_22a17210a21393951ffc3814c248fb89_800.png)
<\/picture>![\"survey-segmentation-in-userpilot\"](\"https:\/\/images.storychief.com\/account_6827\/survey-segmentation-in-userpilot_5ab2f30b7699358607fd82c38f868e4e_800.png)
<\/picture>Results: 4X more response rates for in-app invitations<\/h2>\n
![\"results-of-usability-test-survey\"](\"https:\/\/images.storychief.com\/account_6827\/results-of-usability-test-survey_4ba0874a9558ff8dfcbe1d369de5c926_800.png)
<\/picture>![\"feedback-feature-survey-results\"](\"https:\/\/images.storychief.com\/account_6827\/feedback-feature-survey-results_d2f8d6279cc1adbc459007dd86446ee1_800.png)
<\/picture>How to perform user research with Userpilot?<\/h2>\n
Collect customer feedback through surveys<\/h3>\n
![\"userpilot-survey-templates\"](\"https:\/\/d37oebn0w9ir6a.cloudfront.net\/account_6827\/userpilot-survey-templates_217ce80c3b3dc3c63c4a6f4316efcddb.gif)
<\/picture>Analyze customer behavior data over time<\/h3>\n
\n
![\"trend-analysis-in-userpilot\"](\"https:\/\/images.storychief.com\/account_6827\/trend-analysis-in-userpilot_219928f7881d0fe8cbb6cecf498a417e_800.png)
<\/picture>Conduct A\/B testing for product experiments<\/h3>\n
![\"ab-testing-in-userpilot-copy\"](\"https:\/\/images.storychief.com\/account_6827\/ab-testing-in-userpilot-copy_b3d8ae92bd23b71193ee20ba29564442_800.png)
<\/picture>Conclusion<\/h2>\n
![](\"https:\/\/userpilot-website-assets.s3.us-west-2.amazonaws.com\/wp-content\/uploads\/2023\/11\/06101950\/usp-fav-dark.png\"){kind=icon}
<\/p>\n![\"\"](\"https:\/\/blog-static.userpilot.com\/blog\/wp-content\/uploads\/2024\/01\/userpilot-features-preview.png\")
<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"