User Analysis in 2026: How to Have AI Aid Your Research Instead of Breaking It
Traditionally, user analysis has been about understanding the people who use your product.
But today, that definition is quietly breaking down. A growing share of activity in SaaS products is coming from AI agents, a bunch of companies are running user research with synthetic users, and researchers are actively adopting AI tools to save time. According to MRII’s AI in Focus 2025 report, 62% of market researchers now use AI to automate tasks like literature reviews, data processing, and report generation.
Despite this, I don’t think the fundamentals of good user analysis have changed, but the context has. So rather than another walkthrough of the basics, I want to cover what’s actually different right now and how to adopt your approach. I’ll walk through:
- What’s shifting in the overall shape of user analysis in 2026.
- How each type of user analysis is being affected by AI, and what good practice looks like in each one.
- The workflow we actually use at Userpilot for analyzing users.
- Why human judgment is still the thing that makes all of this worth doing.
The shape of user analysis in 2026
User analysis is the process of collecting and interpreting data to understand how users experience a product, what they like about it, and why they churn. But with AI disrupting user analysis in multiple ways, there are three main topics to pay attention to:
- Agentic behavior: AI agents operating via MCP servers complete tasks inside SaaS products, and most teams are blind to them. However, these agents don’t behave like humans. Instead of navigating by clicking through menus, they call functions directly, skip intermediate steps, and never trigger the idle-time or scroll-depth signals.
- AI-assisted research: AI is now transcribing interviews, clustering survey responses, summarizing patterns across multiple studies, and generating first-draft questionnaires. The MRII report found that researchers are using AI primarily for time savings and streamlining routine tasks, but fewer than half cite improved insights or better decision-making as a benefit.
- Synthetic users: Tools that generate AI-simulated research participants save you the cost of recruiting and scheduling for user testing. But NNGroup’s research on synthetic users found they readily generate long lists of needs and pain points with limited understanding of their actual priority. They cannot capture the nonverbal cues, emotional reactions, and contextual surprises that make real user research valuable for decisions. This means synthetic users might be useful for stress-testing a research protocol or generating hypotheses, but they are not a substitute for real testers.
The teams doing the best user analysis right now are the ones who’ve built explicit rules for which inputs to trust, under what conditions, for which decisions.
The types of user analysis that AI improves
As you might know, user analysis involves different methods designed to answer different kinds of questions. AI is affecting every one of these types, but not in the same way or to the same degree. So I’ll walk through each type of user analysis that’s still worth doing in 2026.
User research
User research covers the qualitative methods to understand why users behave the way they do. This includes:
- User interviews: One-on-one conversations focused on understanding how users think about a problem space or specific workflow, best for surfacing reasoning that behavioral data can’t capture.
- Focus groups: Facilitated group discussions useful for understanding how users talk about a problem and what language they use, best in early-stage research before you’ve defined the problem space.
- Contextual inquiry: Observing users in their actual work environment, which almost always surfaces constraints and workarounds that scheduled interviews miss, best for understanding problems that users have adapted around.
- Diary studies: Longitudinal research where users record their experiences over time, best for problems that develop gradually rather than appearing on first contact with a feature.
Today, most research teams use AI for transcription, initial thematic coding, and generating draft summaries of interview batches. According to the Lyssna survey, analysis and finding patterns are the most common AI use cases among researchers, cited by 23% of respondents. This is one aspect of AI that’s actually saving time and budget for teams.
Another AI-driven solution for user research is synthetic users. They can respond to interview questions, complete prototype tasks, and rank features by preference, with lower overall costs and zero scheduling issues. But as Konstantinos Papangelis wrote in ACM Interactions: AI-generated personas systematically reinforce existing assumptions rather than surfacing the surprises that user research is designed to catch. This means that if you’re going to use synthetic users for research, make sure to treat the data points as mere hypotheses and not conclusions.
User profiles
A user profile is a collection of data, settings, and behavioral logs linked to a specific individual using your product. It involves collecting and consolidating multiple sources of user data into one platform where you can analyze individual users (often via a CDP). For product teams, Userpilot’s user profiles include the most helpful data, including:
- Basic properties.
- Engagement data and recent events.
- Segments.
- Survey responses.
- Latest session replays.
In 2026, user data includes how they use agents to interact with your product, which means you have to find a way to identify and tag agent behaviors. On the other hand, AI assistance can help you in many ways, such as flagging behavioral patterns you haven’t identified or finding anomalies in user profiles that require your attention.

User testing
Usability testing is the practice of making participant users perform specific tasks within a product, with a “researcher” observing behaviors and listening to feedback on usability.
The problem with user tests is that they always have three pain points: it costs money, it takes time to recruit participants, and it’s hard to prove that the insights led to measurable outcomes.
Now, with synthetic users having more awareness, teams are tempted to use them when they lack time and budget. But as I explained, when teams replace real user sessions with synthetic participants to cut costs, their decisions become weak and hard to defend.
I personally recommend targeting in-app surveys to specific user segments to invite them to usability tests. This lets us find high-quality participants that are already familiar with our product, without dealing with providers like UserTesting. For now, you can use AI for desk research, learn the basic vocabulary of an unfamiliar industry, and auto-transcribe/synthesize the test recordings.

Behavioral analysis
The goal of behavioral analysis is to understand how users interact with a product. It involves tracking feature usage, mapping funnel drop-offs, identifying the actions that correlate with retention, and those that correlate with churn.
There are many types of behavior analysis, with the most important being:
- Funnel analysis: Where you observe how users complete key tasks in a funnel view, showing those who drop off.
- Path reports: It shows the events that happened prior to or after a specific event (e.g., a purchase, activation task, signup, etc.).
- Trend analysis: Illustrates usage trends inside your product.
- Retention cohorts: Keeps track of the retention rate of different groups of users.
- Session replays: Lets you watch the session of a user to spot bugs and friction points.
Also, AI-assisted behavioral analysis is improving this. Lia (Userpilot’s AI agent) monitors feature adoption trends and surfaces anomalies without waiting for a team member to check the dashboard. When something changes in how users are engaging with a feature, Lia flags it proactively.

User sentiment analysis
User sentiment analysis means understanding how users feel about the product. Either through structured feedback (NPS, CSAT, CES) or unstructured qualitative data from open-ended surveys, interviews, and support interactions.
Here, AI is making the synthesis side of this dramatically faster. The MRII report found that 76% of researchers use AI for data processing and analysis efficiency. For sentiment analysis, this means AI can cluster open-ended NPS responses by theme, identify the most common friction points in support tickets, or summarize what a segment of users said across 50 interviews. Done well, this compresses weeks of analysis into hours while keeping the actual interpretation in human hands.
However, knowing which question to ask which segment still requires human judgment. In our own surveys at Userpilot, we use behavioral triggers to ensure NPS surveys fire at moments that reflect a meaningful product experience.

Agentic analysis
Agentic analysis is the new category that covers how users interact with agents, and how these agents interact with your product. This includes what tasks they attempt, complete, or fail, and what the satisfaction signal looks like for an agent-driven interaction.
The metrics that matter for agentic analysis are different from human behavioral metrics. Think of task completion rate, tool call success rate, failure patterns (which API calls return errors, which tool handoffs break), etc.
The reason you should care about this is that agents can still churn. There’s an intent behind it that your product should fulfill. If an AI agent repeatedly fails to complete a task in your product, the human who deployed that agent will find a different product that works.

How to perform a user analysis: Our process for 2026
The most expensive user research isn’t the one that costs money; it’s the research that sat in a document nobody acted on. So the process I’m going to walk through is designed to help you and your team make meaningful decisions and act.

1. Define your analysis goals against organizational objectives
A common failure mode in user analysis is to collect data points that don’t influence any decision. This happens because most companies are collecting far more data than they use, leading to analysis paralysis.
Instead, when you define your analysis goal narrowly, you also define which data is relevant, making it easier to stay focused and reach a decision rather than getting lost in the data.
For this, I recommend working backward from the most meaningful business metric and asking which user behavior is most likely driving it. If the metric is activation rate, the user analysis goal is to find where in the onboarding flow users are stopping and why. If the metric is expansion revenue, the goal is to identify which features power users engage with that non-power users don’t, and what would close that gap.
AI can help here. Lia, for example, can surface the behavioral patterns most correlated with the metric you’re tracking, so you’re not starting from scratch when forming hypotheses. Just note that the framing of the goal itself, though, comes from a human who understands what the business actually needs.
2. Define the analysis methods you’ll use
Once the goal is clear, the next step is deciding what methods you’ll need for your analysis. For example, if our goal is to improve activation rates by reducing onboarding friction, then we’ll need to use behavioral reports (i.e., funnels, paths, and trends), sentiment analysis via surveys, and session replays.
In your case, I recommend thinking about your goal and list any of the methods I explained earlier. Then filter them based on these questions:
- Does this connect to the analysis goal? If the goal is to understand why new users aren’t reaching activation, feature usage data from your power-user segment is irrelevant.
- Is it behavioral or declarative? Behavioral data (what users actually do) is almost always more reliable than declarative data (what users say they do). Track what happened in the product first, then supplement with survey responses when you need to understand the why.
- Can you act on it within this cycle? Prioritize data that can drive a decision now. There’s no point collecting data on a problem you can’t address.
- Is it clean enough to trust? Check for tracking issues and make sure the method you use is accurate.
- Who will act on this, and how? Before adding a metric to your analysis, name the person who will use it and the decision it will inform. If the answer is vague (“the team will find it useful”), the metric probably doesn’t belong here.
Note: The tech stack used to connect user data matters a lot here. If user data lives in three separate tools with no easy way to cross-reference them, your ability to correlate the signals is limited. Userpilot consolidates what product teams need in one place. You can see a funnel drop-off, pull the session replays for users who dropped at that step, and check whether any of them submitted a support ticket or negative NPS response, all without switching tools.
3. Identify high-value problems
The goal of this step is to investigate the user segments most relevant to your analysis objective, find the gaps, bottlenecks, and patterns that explain what you’re seeing in the business metric, and generate specific hypotheses about what’s causing them.
If I’m investigating the onboarding flow to improve activation, for example, I’d start with segmenting new users, power users, and churned users. Then, I’d use funnel analysis to see where new users are stopping (plus path analysis to observe how power users go through onboarding). And finally, I’d watch session replays of churned users to watch how the friction happened.

AI is genuinely useful at this stage. For us, Lia monitors all key metrics and proactively surfaces recommendations when a key metric changes. Sure, the output is still just a hypothesis, but it’s a faster starting point.

4. Validate hypotheses to generate actionable insights
Once you’ve collected valuable data points, the next step is to validate your hypotheses by cross-referencing them with evidence.
Our go-to is to cross-reference quantitative data with qualitative data. Kevin O’Sullivan (our senior product designer) describes this better:
“The best way of conducting any sort of research is not to follow one method only. Try to marry the quantitative with the qualitative. Session replay is the perfect blend: it’s a qualitative method, watching sessions, at quantitative scale, every single user who’s ever interacted with the feature.”
If, during onboarding, the funnel shows a 40% drop-off at the domain verification step, I’d check whether session replays show confusion at that step, or whether survey responses mention setup friction. When all three point to the same problem, there’s an insight. When they conflict, the conflict itself is the insight, and it usually means you have to use other methods.
5. Take action and measure the results
Acting on user analysis insights can take different forms, from roadmap change to just adding a tooltip.
When we launched Userpilot’s email feature, the funnel for the setup process showed a sharp drop-off at domain verification. Instead of queuing an engineering ticket and waiting for a sprint, I built a contextual tooltip and checklist directly in Userpilot in a few hours, highlighting exactly what users needed to do to clear that step. The drop-off rate quickly returned to normal, with no dev involvement at all.
That said, this process is inherently iterative, so the best is to run these cycles quickly. Thankfully, AI can help this iteration in many ways:
- Continuous metric monitoring post-intervention: An AI agent monitors the relevant metrics from the moment the change goes live and alerts you when a meaningful result occurs.
- Behavioral trigger-based interventions: AI agents connected to your analytics platform can close the detection-to-response loop automatically for routine cases. When a user’s behavioral pattern crosses a defined threshold, the agent can trigger a checklist, a tooltip, a proactive outreach flow, and so on.
- Proactive recommendations: When an intervention doesn’t produce the expected behavioral change, AI can analyze the post-intervention data, compare it to the pre-intervention baseline, and generate hypotheses for why the solution didn’t work.
In Userpilot, for instance, Lia alerts you when a meaningful behavioral shift occurs and flags when enough time has passed without movement to suggest the solution isn’t working. She can also detect a drop-off, match it to an existing flow in your Userpilot library, and trigger it for the affected segment automatically via MCP.
How to make AI shape your user intelligence instead of breaking it
AI is putting user analysis in an odd spot. Most teams are missing out on agent analytics, synthetic users are reducing data quality, while AI is making real user research faster and cheaper to run.
But I’m confident about this: Human judgment doesn’t get less important as the tooling gets more powerful. It gets more important because the cost of applying it to the wrong question scales with the speed of execution. The analysts and PMs who know how to ask the right questions get more value from AI than those who delegate critical thinking to it.
If you want to start pulling cleaner user analysis from behavioral data, session replays, and in-app feedback in one place, book a Userpilot demo. We’ll walk you through how we set it up for teams like yours.