{"id":116799,"date":"2023-07-31T19:10:11","date_gmt":"2023-07-31T19:10:11","guid":{"rendered":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/"},"modified":"2024-09-16T17:57:39","modified_gmt":"2024-09-16T17:57:39","slug":"ab-testing-metrics","status":"publish","type":"post","link":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/","title":{"rendered":"10 A\/B Testing Metrics To Track Results and Measure Success"},"content":{"rendered":"<h2 id=\"8qkvi\"><strong>What is A\/B testing?<\/strong><\/h2>\n<p>A\/B testing is a scientific, evidence-based method to optimize the performance of a product or landing page. It tests a variation of a product, a marketing campaign, or an ad against a control group to:<\/p>\n<p>1) See if it outperforms the original version.<br \/>\n2) Determine with statistical significance what elements bring better results (e.g. what headline makes a winning landing page for e-commerce companies).<\/p>\n<p>However, the key to making A\/B testing a worthy investment is to have a clear metric that aligns with business objectives.<\/p>\n<h2 id=\"eju28\"><strong>How to choose the right A\/B testing metrics?<\/strong><\/h2>\n<p>To conduct productive A\/B tests, there needs to be a structured framework and a measurable definition of success.<\/p>\n<p>First, you must define the testing goal by stating what you want to accomplish. Do you want to increase sales? Expand brand recognition? Or achieve revenue growth?<\/p>\n<p>Then, to determine the right metric for your experiments, you must follow a proper <a href=\"https:\/\/userpilot.com\/blog\/product-metrics-framework\/\" target=\"_blank\" rel=\"noopener noreferrer\">metric framework<\/a> such as:<\/p>\n<ul>\n<li><strong><a href=\"https:\/\/userpilot.com\/blog\/google-heart-framework\/\" target=\"_blank\" rel=\"noopener noreferrer\">Google\u2019s HEART framework.<\/a> <\/strong>Which is aimed to improve the user experience through five dimensions: Happiness, engagement, adoption, retention, and task success.<\/li>\n<li><strong><a href=\"https:\/\/userpilot.com\/blog\/pirate-metrics-saas\/\" target=\"_blank\" rel=\"noopener noreferrer\">Pirate Metrics framework<\/a> (AARRR). <\/strong> Which organizes your key metrics based on the stages of the user journey, including: Acquisition, activation, retention, referrals, and revenue.<\/li>\n<li><strong><a href=\"https:\/\/userpilot.com\/blog\/north-star-metric\/\" target=\"_blank\" rel=\"noopener noreferrer\">North Star Metrics framework<\/a>. <\/strong>Where your whole company chooses a \u201cnorth star metric\u201d that every single team should aim to improve (ex: per user for an e-commerce business). Such metrics should have specific characteristics:<\/li>\n<\/ul>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/north-star-metrics-checklist_505458890c808e1b7c2a473532f3b79f_800.png 1x, https:\/\/images.storychief.com\/account_6827\/north-star-metrics-checklist_505458890c808e1b7c2a473532f3b79f_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/north-star-metrics-checklist_505458890c808e1b7c2a473532f3b79f_800.png 1x, https:\/\/images.storychief.com\/account_6827\/north-star-metrics-checklist_505458890c808e1b7c2a473532f3b79f_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/north-star-metrics-checklist_505458890c808e1b7c2a473532f3b79f_800.png\" alt=\"North star metrics checklist.\" \/><\/picture><figcaption>North Star metrics checklist.<\/figcaption><\/figure>\n<p>Why follow a framework? Because you\u2019re going to need a clear goal and structure in order to define your primary and secondary metrics, where:<\/p>\n<ul>\n<li>The primary metric is the main indicator of success (which you actively want to improve).<\/li>\n<li>The secondary metrics can help you understand how performance is improved (although not representative of success).<\/li>\n<\/ul>\n<p>For instance, if your primary metric is conversion rates, metrics such as average session duration, bounce rate, and click-through rate will help you get valuable insights into changes in conversion rates.<\/p>\n<p>Now, let\u2019s go over 10 metrics every SaaS can A\/B test to optimize their success:<\/p>\n<h2 id=\"82eps\"><strong>Top 10 A\/B testing metrics for measuring success<\/strong><\/h2>\n<p>As we mentioned, the best metric for you will depend on your business, goals, and the metric framework you follow.<\/p>\n<p>Still, at least 10 metrics are common among SaaS businesses. So let\u2019s take a look over what they\u2019re and how they\u2019re calculated.<\/p>\n<p><strong>Note: <\/strong>When calculating your A\/B testing KPIs, remember that your metrics should be time-bound, which means they can only be measured during the period of the A\/B test when comparing two versions.<\/p>\n<h3 id=\"4qh21\"><strong>Conversion rate<\/strong><\/h3>\n<p>Conversion rate is the percentage of users who perform a specific action (a conversion), such as signing up, purchasing a plan, or upgrading. To calculate it, divide the number of website visitors who performed the desired action by the number of traffic you got during a period.<\/p>\n<p>In SaaS, for instance, you can A\/B test <a href=\"https:\/\/userpilot.com\/blog\/how-to-increase-free-trial-conversion\/\" target=\"_blank\" rel=\"noopener noreferrer\">free trial conversion rates<\/a>. To do so, you\u2019d need to divide the number of free trial users who converted into premium users by the number of free trial users generated during the testing period.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/free-trial-conversion-rate-ab-testing-metrics_93cde0554be7c679f1378e22bc3142ed_800.png 1x, https:\/\/images.storychief.com\/account_6827\/free-trial-conversion-rate-ab-testing-metrics_93cde0554be7c679f1378e22bc3142ed_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/free-trial-conversion-rate-ab-testing-metrics_93cde0554be7c679f1378e22bc3142ed_800.png 1x, https:\/\/images.storychief.com\/account_6827\/free-trial-conversion-rate-ab-testing-metrics_93cde0554be7c679f1378e22bc3142ed_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/free-trial-conversion-rate-ab-testing-metrics_93cde0554be7c679f1378e22bc3142ed_800.png\" alt=\"free trial conversion rate ab testing metrics\" \/><\/picture><figcaption><a href=\"https:\/\/userpilot.com\/blog\/free-trial-conversion-rate\/\">Free trial conversion rate<\/a> formula.<\/figcaption><\/figure>\n<h3 id=\"b8ahr\"><strong>Active users<\/strong><\/h3>\n<p>Active users are the volume of users who interact with your product constantly. In short, it\u2019s the number of people who use your app and indicates general user engagement.<\/p>\n<p>Google Analytics and any <a href=\"https:\/\/userpilot.com\/blog\/customer-success-tools-saas\/\" target=\"_blank\" rel=\"noopener noreferrer\">customer success tool <\/a>like Userpilot can track active users for you and allow you to filter by months or even user segments. And when it comes to A\/B testing, you can run experiments to optimize user engagement by testing product changes against a control group and see if it represents a significant improvement.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/active-users-ab-testing-metrics_f45ebe47c2de3c8866b2b9daeac0aff2_800.png 1x, https:\/\/images.storychief.com\/account_6827\/active-users-ab-testing-metrics_f45ebe47c2de3c8866b2b9daeac0aff2_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/active-users-ab-testing-metrics_f45ebe47c2de3c8866b2b9daeac0aff2_800.png 1x, https:\/\/images.storychief.com\/account_6827\/active-users-ab-testing-metrics_f45ebe47c2de3c8866b2b9daeac0aff2_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/active-users-ab-testing-metrics_f45ebe47c2de3c8866b2b9daeac0aff2_800.png\" alt=\"active users ab testing metrics\" \/><\/picture><figcaption>Tracking user activity on <a href=\"https:\/\/userpilot.com\/userpilot-demo\" target=\"_blank\" rel=\"noopener noreferrer\">Userpilot<\/a>.<\/figcaption><\/figure>\n<h3 id=\"f1sqb\"><strong>Average session duration<\/strong><\/h3>\n<p>Average session duration measures how long a website visitor stays logged into your app. Depending on your app, it can indicate that users are having a positive experience and getting satisfied with it.<\/p>\n<p>When A\/B testing, an increase in session durations can represent a positive experience if your product is designed for it or if there&#8217;s a key element that makes your product more efficient. So it\u2019s a great secondary metric to track along with conversion rates or <a href=\"https:\/\/userpilot.com\/blog\/customer-satisfaction-benchmarking\/\" target=\"_blank\" rel=\"noopener noreferrer\">customer satisfaction<\/a>.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/session-duration-ab-testing-metrics_c0baa74fcd2bec7c063fcb82753f33fb_800.png 1x, https:\/\/images.storychief.com\/account_6827\/session-duration-ab-testing-metrics_c0baa74fcd2bec7c063fcb82753f33fb_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/session-duration-ab-testing-metrics_c0baa74fcd2bec7c063fcb82753f33fb_800.png 1x, https:\/\/images.storychief.com\/account_6827\/session-duration-ab-testing-metrics_c0baa74fcd2bec7c063fcb82753f33fb_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/session-duration-ab-testing-metrics_c0baa74fcd2bec7c063fcb82753f33fb_800.png\" alt=\"session duration analytics ab testing metrics\" \/><\/picture><figcaption>Analyzing user sessions on <a href=\"https:\/\/userpilot.com\/userpilot-demo\" target=\"_blank\" rel=\"noopener noreferrer\">Userpilot<\/a>.<\/figcaption><\/figure>\n<h3 id=\"bndoh\"><strong>Events per session<\/strong><\/h3>\n<p>Events per session, as the name suggests, track the <a href=\"https:\/\/userpilot.com\/blog\/event-data\/\" target=\"_blank\" rel=\"noopener noreferrer\">number of interactions<\/a> a user has with your product during their session (clicks, tasks completed, etc). And you need a platform with <a href=\"https:\/\/userpilot.com\/blog\/event-based-analytics\/\" target=\"_blank\" rel=\"noopener noreferrer\">feature tagging<\/a> to measure it.<\/p>\n<p>This metric is designed to represent customer behavior, so an increase in events per session can represent better usability when paired with a primary metric. This is as long as you didn\u2019t make changes that artificially increase the steps needed to complete a task.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/d37oebn0w9ir6a.cloudfront.net\/account_6827\/feature-tagging-ab-testing-metrics_d402a5ce0fdd5c9555592cd1ad29708a.gif 1x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/d37oebn0w9ir6a.cloudfront.net\/account_6827\/feature-tagging-ab-testing-metrics_d402a5ce0fdd5c9555592cd1ad29708a.gif 1x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/d37oebn0w9ir6a.cloudfront.net\/account_6827\/feature-tagging-ab-testing-metrics_d402a5ce0fdd5c9555592cd1ad29708a.gif\" alt=\"feature tagging for ab testing metrics\" \/><\/picture><figcaption>Feature tagging with <a href=\"https:\/\/userpilot.com\/userpilot-demo\" target=\"_blank\" rel=\"noopener noreferrer\">Userpilot<\/a>.<\/figcaption><\/figure>\n<h3 id=\"22f0n\"><strong>Goal completion<\/strong><\/h3>\n<p>Goal completion is the number of users who achieve a specific milestone using your product, such as creating their first campaign or adding teammates.<\/p>\n<p>With a tool like Userpilot, you can (for example) A\/B test your <a href=\"https:\/\/userpilot.com\/blog\/goal-oriented-user-onboarding\/\" target=\"_blank\" rel=\"noopener noreferrer\">in-app onboarding<\/a> to optimize the number of users who reach the <a href=\"https:\/\/userpilot.com\/blog\/customer-activation\/\" target=\"_blank\" rel=\"noopener noreferrer\">activation stage<\/a>. Making it a great metric to optimize user behavior in a SaaS business.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/set-ab-test-goal-for-tracking-engagement-ab-testing-metrics_00bf52fd29f3a3bc7d7c294e816f16e6_800.jpg 1x, https:\/\/images.storychief.com\/account_6827\/set-ab-test-goal-for-tracking-engagement-ab-testing-metrics_00bf52fd29f3a3bc7d7c294e816f16e6_1600.jpg 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/set-ab-test-goal-for-tracking-engagement-ab-testing-metrics_00bf52fd29f3a3bc7d7c294e816f16e6_800.jpg 1x, https:\/\/images.storychief.com\/account_6827\/set-ab-test-goal-for-tracking-engagement-ab-testing-metrics_00bf52fd29f3a3bc7d7c294e816f16e6_1600.jpg 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/set-ab-test-goal-for-tracking-engagement-ab-testing-metrics_00bf52fd29f3a3bc7d7c294e816f16e6_800.jpg\" alt=\"ab testing metrics goals\" \/><\/picture><figcaption>Tracking goals on <a href=\"https:\/\/userpilot.com\/userpilot-demo\" target=\"_blank\" rel=\"noopener noreferrer\">Userpilot<\/a>.<\/figcaption><\/figure>\n<h3 id=\"dna32\"><strong>Retention rate<\/strong><\/h3>\n<p><a href=\"https:\/\/userpilot.com\/blog\/retention-rate-meaning\/\" target=\"_blank\" rel=\"noopener noreferrer\">Retention rate<\/a> measures the percentage of paying users that stay with you over a month, quarter, or year. And it can be a great secondary metric to track along with business growth (for example) to understand what leads to better satisfaction and user experience.<\/p>\n<p>To calculate it, divide the number of paying users at the end of the time period (without counting new users) by the number of paying users at the beginning of the period.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/retention-rate-ab-testing-metrics_03d5ba2936a0621c87b2cc828439c7e3_800.png 1x, https:\/\/images.storychief.com\/account_6827\/retention-rate-ab-testing-metrics_03d5ba2936a0621c87b2cc828439c7e3_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/retention-rate-ab-testing-metrics_03d5ba2936a0621c87b2cc828439c7e3_800.png 1x, https:\/\/images.storychief.com\/account_6827\/retention-rate-ab-testing-metrics_03d5ba2936a0621c87b2cc828439c7e3_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/retention-rate-ab-testing-metrics_03d5ba2936a0621c87b2cc828439c7e3_800.png\" alt=\"retention rate formula\" \/><\/picture><figcaption>Retention rate formula.<\/figcaption><\/figure>\n<h3 id=\"99l8q\"><strong>Churn rate<\/strong><\/h3>\n<p>Contrary to retention rates, <a href=\"https:\/\/userpilot.com\/blog\/customer-churn-rate\/\" target=\"_blank\" rel=\"noopener noreferrer\">customer churn<\/a> is the rate at which customers discontinue their subscriptions or stop using a particular product or service. And it can indicate <a href=\"https:\/\/userpilot.com\/blog\/customer-dissatisfaction\/\" target=\"_blank\" rel=\"noopener noreferrer\">customer dissatisfaction<\/a> and a lack of market fit.<\/p>\n<p>To calculate it, divide the number of users lost during the period of interest by the number of users you had at the start of the period. Then multiply the result by 100.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/formula-for-customer-churn-rate-800_92aee339b420045947a5ea213423c807_800.png 1x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/formula-for-customer-churn-rate-800_92aee339b420045947a5ea213423c807_800.png 1x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/formula-for-customer-churn-rate-800_92aee339b420045947a5ea213423c807_800.png\" alt=\"churn rate formula\" \/><\/picture><figcaption>Churn rate formula.<\/figcaption><\/figure>\n<h3 id=\"2k35m\"><strong>Customer satisfaction score<\/strong><\/h3>\n<p>The customer satisfaction score measures the overall satisfaction sentiment users have at any point in the <a href=\"https:\/\/userpilot.com\/blog\/b2b-saas-customer-journey-map\/\" target=\"_blank\" rel=\"noopener noreferrer\">customer journey<\/a>. It can only be measured through <a href=\"https:\/\/userpilot.com\/blog\/csat-survey-template\/\" target=\"_blank\" rel=\"noopener noreferrer\">CSAT surveys<\/a>, which means it\u2019s not a reliable metric for A\/B testing.<\/p>\n<p>However, <a href=\"https:\/\/userpilot.com\/blog\/improve-csat\/\" target=\"_blank\" rel=\"noopener noreferrer\">CSAT<\/a> can be a great supporting metric when, for example, testing an onboarding <a href=\"https:\/\/userpilot.com\/blog\/interactive-walkthroughs-improve-onboarding\/\" target=\"_blank\" rel=\"noopener noreferrer\">interactive walkthrough<\/a> against a control group. You can trigger a survey at the end of the walkthrough to see if an increase in satisfaction correlates with better onboarding and activation rates.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/csat-ab-testing-metrics_b040492772d1922b59ccfbe5d3552c58_800.png 1x, https:\/\/images.storychief.com\/account_6827\/csat-ab-testing-metrics_b040492772d1922b59ccfbe5d3552c58_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/csat-ab-testing-metrics_b040492772d1922b59ccfbe5d3552c58_800.png 1x, https:\/\/images.storychief.com\/account_6827\/csat-ab-testing-metrics_b040492772d1922b59ccfbe5d3552c58_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/csat-ab-testing-metrics_b040492772d1922b59ccfbe5d3552c58_800.png\" alt=\"csat survey ab testing metrics\" \/><\/picture><figcaption>Creating CSAT surveys with <a href=\"https:\/\/userpilot.com\/userpilot-demo\" target=\"_blank\" rel=\"noopener noreferrer\">Userpilot<\/a>.<\/figcaption><\/figure>\n<h3 id=\"632rm\"><strong>Customer lifetime value<\/strong><\/h3>\n<p><a href=\"https:\/\/userpilot.com\/blog\/saas-metrics-101-ltv-lifetime-value\/\" target=\"_blank\" rel=\"noopener noreferrer\">Customer lifetime value (LTV or CLV)<\/a> is the total revenue a customer will bring to your company throughout their time as a user of your products or services. And it\u2019s calculated by multiplying the average order value by their purchase frequency and finally, multiplying it by their average lifespan.<\/p>\n<p>LTV is a great metric to test along with conversion rates. This way, you can determine the revenue generated with product changes and optimize it.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/ltv-ab-testing-metrics_4e58ea7de3e23d7005f11fa6b0a33134_800.png 1x, https:\/\/images.storychief.com\/account_6827\/ltv-ab-testing-metrics_4e58ea7de3e23d7005f11fa6b0a33134_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/ltv-ab-testing-metrics_4e58ea7de3e23d7005f11fa6b0a33134_800.png 1x, https:\/\/images.storychief.com\/account_6827\/ltv-ab-testing-metrics_4e58ea7de3e23d7005f11fa6b0a33134_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/ltv-ab-testing-metrics_4e58ea7de3e23d7005f11fa6b0a33134_800.png\" alt=\"ltv formula\" \/><\/picture><figcaption>LTV formula.<\/figcaption><\/figure>\n<h3 id=\"5q9jq\"><strong>Revenue<\/strong><\/h3>\n<p>For most companies, revenue is the first A\/B testing metric worth optimizing\u2014with conversion rates as a close second.<\/p>\n<p>By tracking revenue, you can directly optimize your business bottom line by experimenting with different variations that drive more conversions, sales and <a href=\"https:\/\/userpilot.com\/blog\/account-expansion-saas\/\" target=\"_blank\" rel=\"noopener noreferrer\">account expansion<\/a>.<\/p>\n<p>In SaaS, you can track it as your average revenue per user (ARPU), which is calculated by dividing your monthly recurring revenue (MRR) by the number of paying users.<\/p>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/arpu-ab-testing-metrics_d392e20c1a83460d60cedb1bc50a105a_800.png 1x, https:\/\/images.storychief.com\/account_6827\/arpu-ab-testing-metrics_d392e20c1a83460d60cedb1bc50a105a_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/arpu-ab-testing-metrics_d392e20c1a83460d60cedb1bc50a105a_800.png 1x, https:\/\/images.storychief.com\/account_6827\/arpu-ab-testing-metrics_d392e20c1a83460d60cedb1bc50a105a_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/arpu-ab-testing-metrics_d392e20c1a83460d60cedb1bc50a105a_800.png\" alt=\"arpu formula\" \/><\/picture><figcaption>ARPU formula.<\/figcaption><\/figure>\n<h2 id=\"6ud5v\"><strong>How to measure and improve your A\/B test metrics with Userpilot?<\/strong><\/h2>\n<p>In a SaaS, much of your A\/B testing will happen inside your app. Userpilot is a platform that can help you optimize your product performance in different ways, including:<\/p>\n<ul>\n<li>Setting up in-app goals and, for example, test an interactive walkthrough to see if it leads to more goals completed.<\/li>\n<li>Tracking in-app behavior such as clicks (through feature tagging), milestone progress (custom events), or specific interactions Allowing you to A\/B test a feature or in-app experience to optimize the user experience.<\/li>\n<li>Triggering CSAT surveys at specific touchpoints automatically allows you to measure if\u2014for instance\u2014if users are satisfied with your self-service content or with the results they\u2019ve achieved with your product.<\/li>\n<li>Tracking secondary metrics such as active users, product usage, interactions per user, and events per session through advanced <a href=\"https:\/\/userpilot.com\/blog\/product-analytics-guide\/\" target=\"_blank\" rel=\"noopener noreferrer\">product analytics<\/a>. Allowing you to support your A\/B testing results with additional, actionable data.<\/li>\n<\/ul>\n<figure class=\"image strchf-type-image regular strchf-size-regular strchf-align-center\"><picture><source srcset=\"https:\/\/images.storychief.com\/account_6827\/userpilot-ab-testing-metrics_752405eb9422f760f52ed1de279084e8_800.png 1x, https:\/\/images.storychief.com\/account_6827\/userpilot-ab-testing-metrics_752405eb9422f760f52ed1de279084e8_1600.png 2x\" media=\"(max-width: 768px)\" \/><source srcset=\"https:\/\/images.storychief.com\/account_6827\/userpilot-ab-testing-metrics_752405eb9422f760f52ed1de279084e8_800.png 1x, https:\/\/images.storychief.com\/account_6827\/userpilot-ab-testing-metrics_752405eb9422f760f52ed1de279084e8_1600.png 2x\" media=\"(min-width: 769px)\" \/><img decoding=\"async\" src=\"https:\/\/images.storychief.com\/account_6827\/userpilot-ab-testing-metrics_752405eb9422f760f52ed1de279084e8_800.png\" alt=\"userpilot product analytics for ab testing metrics\" \/><\/picture><figcaption><a href=\"https:\/\/userpilot.com\/userpilot-demo\" target=\"_blank\" rel=\"noopener noreferrer\">Userpilot<\/a> product analytics.<\/figcaption><\/figure>\n<h2 id=\"aasr7\"><strong>Conclusion<\/strong><\/h2>\n<p>At the end of the day, the best AB testing metrics are the ones that align with your business goals.<\/p>\n<p>You should always be on the lookout for areas of improvement within the product. So, come up with your hypotheses, conduct multiple tests, and make the most evidence-based decisions available.<\/p>\n<p>Plus, if you\u2019re a product manager who needs to run in-app A\/B tests without code, <a href=\"https:\/\/userpilot.com\/userpilot-demo\" target=\"_blank\" rel=\"noopener noreferrer\">book a demo<\/a> call with our team and get our help!<\/p>\n<div class=\"poptin-embedded\" data-id=\"5e8e45db4e6a4\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>A\/B testing is a scientific, evidence-based method to optimize the performance of a product or landing page. It tests a variation of a product, a marketing campaign, or an ad against a control group. In this article, we talk about the frameworks you can follow as well as provide 10 AB testing metrics that can lead your SaaS to achieve measurable business goals.<\/p>\n","protected":false},"author":55,"featured_media":116801,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[5126,5125,5128,869,883,5127,201],"class_list":["post-116799","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-product-experience","tag-ab-metrics","tag-ab-testing-metrics","tag-ab-tests","tag-customer-journey","tag-key-metrics","tag-metric-framework","tag-user-experience"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.2 (Yoast SEO v27.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>10 A\/B Testing Metrics To Track Results and Measure Success<\/title>\n<meta name=\"description\" content=\"What A\/B testing metrics should a SaaS choose? We review metrics frameworks and provide 10 metrics you should optimize to achieve goals.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"10 A\/B Testing Metrics To Track Results and Measure Success\" \/>\n<meta property=\"og:description\" content=\"What A\/B testing metrics should a SaaS choose? We review metrics frameworks and provide 10 metrics you should optimize to achieve goals.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/\" \/>\n<meta property=\"og:site_name\" content=\"Thoughts about Product Adoption, User Onboarding and Good UX | Userpilot Blog\" \/>\n<meta property=\"article:published_time\" content=\"2023-07-31T19:10:11+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-09-16T17:57:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1876\" \/>\n\t<meta property=\"og:image:height\" content=\"1228\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Linh Khanh\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Linh Khanh\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"10 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/\"},\"author\":{\"name\":\"Linh Khanh\",\"@id\":\"https:\/\/userpilot.com\/blog\/#\/schema\/person\/837ad6c051bf4373e42a8e0091d3d691\"},\"headline\":\"10 A\/B Testing Metrics To Track Results and Measure Success\",\"datePublished\":\"2023-07-31T19:10:11+00:00\",\"dateModified\":\"2024-09-16T17:57:39+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/\"},\"wordCount\":1529,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png\",\"keywords\":[\"AB metrics\",\"AB testing metrics\",\"AB tests\",\"customer journey\",\"key metrics\",\"metric framework\",\"User Experience\"],\"articleSection\":[\"Product Experience\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/\",\"url\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/\",\"name\":\"10 A\/B Testing Metrics To Track Results and Measure Success\",\"isPartOf\":{\"@id\":\"https:\/\/userpilot.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png\",\"datePublished\":\"2023-07-31T19:10:11+00:00\",\"dateModified\":\"2024-09-16T17:57:39+00:00\",\"author\":{\"@id\":\"https:\/\/userpilot.com\/blog\/#\/schema\/person\/837ad6c051bf4373e42a8e0091d3d691\"},\"description\":\"What A\/B testing metrics should a SaaS choose? We review metrics frameworks and provide 10 metrics you should optimize to achieve goals.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#primaryimage\",\"url\":\"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png\",\"contentUrl\":\"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png\",\"width\":1876,\"height\":1228,\"caption\":\"10 A\/B Testing Metrics To Track Results and Measure Success cover\"},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/userpilot.com\/blog\/#website\",\"url\":\"https:\/\/userpilot.com\/blog\/\",\"name\":\"Thoughts about Product Adoption, User Onboarding and Good UX | Userpilot Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/userpilot.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/userpilot.com\/blog\/#\/schema\/person\/837ad6c051bf4373e42a8e0091d3d691\",\"name\":\"Linh Khanh\",\"description\":\"I have a knack for content development and SEO copywriting. My experience expands to managing social media coordination and branding campaigns while working with micro-influencers for better brand promotion.\",\"sameAs\":[\"https:\/\/www.linkedin.com\/in\/khanhlinhle1306?\"],\"url\":\"https:\/\/userpilot.com\/blog\/author\/linh\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"10 A\/B Testing Metrics To Track Results and Measure Success","description":"What A\/B testing metrics should a SaaS choose? We review metrics frameworks and provide 10 metrics you should optimize to achieve goals.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/","og_locale":"en_US","og_type":"article","og_title":"10 A\/B Testing Metrics To Track Results and Measure Success","og_description":"What A\/B testing metrics should a SaaS choose? We review metrics frameworks and provide 10 metrics you should optimize to achieve goals.","og_url":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/","og_site_name":"Thoughts about Product Adoption, User Onboarding and Good UX | Userpilot Blog","article_published_time":"2023-07-31T19:10:11+00:00","article_modified_time":"2024-09-16T17:57:39+00:00","og_image":[{"width":1876,"height":1228,"url":"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png","type":"image\/png"}],"author":"Linh Khanh","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Linh Khanh","Est. reading time":"10 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#article","isPartOf":{"@id":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/"},"author":{"name":"Linh Khanh","@id":"https:\/\/userpilot.com\/blog\/#\/schema\/person\/837ad6c051bf4373e42a8e0091d3d691"},"headline":"10 A\/B Testing Metrics To Track Results and Measure Success","datePublished":"2023-07-31T19:10:11+00:00","dateModified":"2024-09-16T17:57:39+00:00","mainEntityOfPage":{"@id":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/"},"wordCount":1529,"commentCount":0,"image":{"@id":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#primaryimage"},"thumbnailUrl":"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png","keywords":["AB metrics","AB testing metrics","AB tests","customer journey","key metrics","metric framework","User Experience"],"articleSection":["Product Experience"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/","url":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/","name":"10 A\/B Testing Metrics To Track Results and Measure Success","isPartOf":{"@id":"https:\/\/userpilot.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#primaryimage"},"image":{"@id":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#primaryimage"},"thumbnailUrl":"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png","datePublished":"2023-07-31T19:10:11+00:00","dateModified":"2024-09-16T17:57:39+00:00","author":{"@id":"https:\/\/userpilot.com\/blog\/#\/schema\/person\/837ad6c051bf4373e42a8e0091d3d691"},"description":"What A\/B testing metrics should a SaaS choose? We review metrics frameworks and provide 10 metrics you should optimize to achieve goals.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/userpilot.com\/blog\/ab-testing-metrics\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/userpilot.com\/blog\/ab-testing-metrics\/#primaryimage","url":"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png","contentUrl":"https:\/\/blog-static.userpilot.com\/wp-content\/uploads\/2023\/07\/10-ab-testing-metrics-to-track-results-and-measure-success_6da4ad36666d4c19e7f117e3e5d97bde_2000.png","width":1876,"height":1228,"caption":"10 A\/B Testing Metrics To Track Results and Measure Success cover"},{"@type":"WebSite","@id":"https:\/\/userpilot.com\/blog\/#website","url":"https:\/\/userpilot.com\/blog\/","name":"Thoughts about Product Adoption, User Onboarding and Good UX | Userpilot Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/userpilot.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/userpilot.com\/blog\/#\/schema\/person\/837ad6c051bf4373e42a8e0091d3d691","name":"Linh Khanh","description":"I have a knack for content development and SEO copywriting. My experience expands to managing social media coordination and branding campaigns while working with micro-influencers for better brand promotion.","sameAs":["https:\/\/www.linkedin.com\/in\/khanhlinhle1306?"],"url":"https:\/\/userpilot.com\/blog\/author\/linh\/"}]}},"_links":{"self":[{"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/posts\/116799","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/users\/55"}],"replies":[{"embeddable":true,"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/comments?post=116799"}],"version-history":[{"count":3,"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/posts\/116799\/revisions"}],"predecessor-version":[{"id":239910,"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/posts\/116799\/revisions\/239910"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/media\/116801"}],"wp:attachment":[{"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/media?parent=116799"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/categories?post=116799"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/userpilot.com\/blog\/wp-json\/wp\/v2\/tags?post=116799"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}