Story Template

User Retention

Open Template

You need to have Vespucci installed

A practical guide to user retention.

Retention is a key ingredient of your product. It's particularly important in terms of unit economics, as it basically determines the period over which you amortize the fixed costs associated with your users. These fixed costs are the expenses you have incurred to bring the user to your product. In the case of a B2C product, these expenses are often advertising campaigns on social networks; in the case of a B2B product, they may be the costs associated with onboarding a user. This is why retention is such a closely scrutinized metric.

Define what to measure

Check the tagging plan

Uncover valuable Insigths

How to measure retention ?

Retention isn't all that easy to measure. Worse still, once you've measured it, it's even harder to understand. What makes your users abandon your product after a few sessions? What, on the contrary, drives your users to make a lasting commitment to your experience? These are the issues we're going to look at trough this guide.

First of all, how do you measure retention? There are several definitions of retention, and we propose to cover two of them today.

N-Day Retention

The first way to measure retention is by using what's known as n-day retention. This is the percentage of users who return to your product n-days after their first session. This is a very restrictive definition; if we consider day-2 retention, for example, we'll be looking at users using your solution two days after their first session. So if a user uses your product on the first and third day after their first use, they won't be included in day-2 retention if you use the n-day measure.

Retention Measures
Unbounded retention

Another way of measuring user retention is to use what's known as unbounded retention (some sites or tools will use the term rolling retention, which is the same thing).  In this measurement, we consider the percentage of users who return on the nth day or any time after that date. In our above example, the user using the product on the first and third day will be included in day-2 retention using the unbounded retention metric.

Retention Measures

As you can see, the choice of definition can lead to very different observations in terms of retention. So when should you choose one measure or the other?It's never easy to establish absolute truths, as everything depends on your product. That's why both measures exist, as they are both relevant in different contexts. But, If you've launched a major marketing campaign, or a Product Hunt launch, then the n-days retention metric is relevant for measuring how the users in that cohort behave. If you're analyzing longer-term behavior, unbounded measurement is probably more relevant. Another relatively obvious example of the use of unbounded measurement is the context of your product. For example, if you operate an air ticket booking app, an n-days metric is not very relevant.However, there's one big advantage of n-day retention: it delivers definitive results. Unbounded retention is potentially subject to change at any time in the future. For example, imagine a user downloads a mobile app on day one, uses it a little on the first day and then doesn't use it again. He is therefore not included in the retention (n-day and unbounded) of the second day. But then, 182 days later, he decides to reopen the app. This action will have the effect of increasing the d2 retention 182 days later in the case of the unbounded measure.

Let's put it into practice

That's it for the theory, now it's time to put it into practice. To analyze your users' retention with Vespucci, start by creating a new story. Use the template on the left to start your exploration.

Step 0: Do you want to measure Retention or Churn ?

The question is deliberately provocative: the first parameter of the template allows you to select users who continue to use your product n-days after a target action or, on the contrary, those who stop using it after a certain period of time. Note that in the latter case you could also use a template that measures churn.

Step 1: Setup the time window.

The second parameter is quite self-explanatory: you specify the time criterion associated with your retention measurement. Do you want to measure retention at 30 days, 3 months, etc.?

Step 2: Setup the target event.

This setting deserves our attention. Up to now, we've always considered users still active n days after their first sessions on the product. This may not be the most appropriate definition. You might want to refine the basis for calculating retention. Let's say you've developed a sports tracking app. This app requires the iPhone to be paired with an Apple Watch to really work. However, after appearing on a specialized podcast, curious users download your app and arrive at the screen inviting them to share their watch's health data. It goes without saying that these users will never open your app again. They will negatively affect your retention. But was it necessary to include them? Probably not.

To illustrate how it is possible to constrain the measurement of retention, let's consider another example, adapted from a case we actually experienced with one of our customers. A social networking app faced a challenge: it was impossible to engage (and therefore retain) a user if they didn't have at least a few friends from their existing network in the app (imagine replacing WhatsApp or iMessage with an app that none of your contacts use...). So they decided to set up all kinds of initiatives and goodies in the app to encourage a new user to invite their contacts into the app. Only after a user has added 3 of these friends to the app are they included in the retention measurement. For n-day retention their metric looked like this: the percentage of users who return to their product n-days after adding their third friend to the app. It's precisely these kinds of constraints that the last frame lets you define.

Step 3: Identify the drivers.

Now we're getting to the heart of the matter. Vespucci enables you to identify the elements that increase the likelihood of your template being realized. In other words, we can help you identify the elements that will increase user retention. These elements are very diverse, and relate to questions of segmentation (e.g. do the characteristics of your users declared during their onboarding affect their retention?) of content, or even to certain actions performed by your users when using your product. To explore these elements, use the insight finder (accessible from the toolbar by selecting the brain icon in the top left-hand corner) or explore our guides.

Build the rigth taging plam.

You absolutely must have certain elements within your tagging plan to track user retention. However, some approaches are more demanding than others.

Identify your users' first session.

One approach is to create a first launch property. You'll need to define this property as a "user property" if you're using Amplitude, or attach it to an "identity" if you're using Segment. The advantage of this approach is its robustness. You don't have to go through your entire data set to find the first session of each of your users. The disadvantage is its lack of flexibility: it doesn't allow you to define the starting point of retention based on the performance of a specific action.

Event based approach.

The most obvious and flexible approach is to use the event flow of your taging plan. This allows you to calculate retention after the first occurrence of a specific action. However, this approach can be challenging, as it requires you to process and have access to all your historical data. Such an approach is even impossible to implement in certain Segment setups.

"Index" based approcah.

A final approach is an "hybrid" approach. It can be implemented in several ways. The simplest is to define the "first launch" property mentioned in the first approach on the basis of finer criteria. For example, you could track not the date of the first launch, but that of a particular, more relevant action. You could also consider implementing a more complex, but more flexible, solution based on a dictionary. The keys of this dictionary would consist of a series of remarkable properties that you would have identified beforehand, while their values would correspond to the time stamps associated with these actions

Story Template

User Retention

Open Template

You need to have Vespucci installed

A practical guide to user retention.

Retention is a key ingredient of your product. It's particularly important in terms of unit economics, as it basically determines the period over which you amortize the fixed costs associated with your users. These fixed costs are the expenses you have incurred to bring the user to your product. In the case of a B2C product, these expenses are often advertising campaigns on social networks; in the case of a B2B product, they may be the costs associated with onboarding a user. This is why retention is such a closely scrutinized metric.

Define what to measure

Check the tagging plan

Uncover valuable Insigths

How to measure retention ?

Retention isn't all that easy to measure. Worse still, once you've measured it, it's even harder to understand. What makes your users abandon your product after a few sessions? What, on the contrary, drives your users to make a lasting commitment to your experience? These are the issues we're going to look at trough this guide.

First of all, how do you measure retention? There are several definitions of retention, and we propose to cover two of them today.

N-Day Retention

The first way to measure retention is by using what's known as n-day retention. This is the percentage of users who return to your product n-days after their first session. This is a very restrictive definition; if we consider day-2 retention, for example, we'll be looking at users using your solution two days after their first session. So if a user uses your product on the first and third day after their first use, they won't be included in day-2 retention if you use the n-day measure.

Retention Measures
Unbounded retention

Another way of measuring user retention is to use what's known as unbounded retention (some sites or tools will use the term rolling retention, which is the same thing).  In this measurement, we consider the percentage of users who return on the nth day or any time after that date. In our above example, the user using the product on the first and third day will be included in day-2 retention using the unbounded retention metric.

Retention Measures

As you can see, the choice of definition can lead to very different observations in terms of retention. So when should you choose one measure or the other?It's never easy to establish absolute truths, as everything depends on your product. That's why both measures exist, as they are both relevant in different contexts. But, If you've launched a major marketing campaign, or a Product Hunt launch, then the n-days retention metric is relevant for measuring how the users in that cohort behave. If you're analyzing longer-term behavior, unbounded measurement is probably more relevant. Another relatively obvious example of the use of unbounded measurement is the context of your product. For example, if you operate an air ticket booking app, an n-days metric is not very relevant.However, there's one big advantage of n-day retention: it delivers definitive results. Unbounded retention is potentially subject to change at any time in the future. For example, imagine a user downloads a mobile app on day one, uses it a little on the first day and then doesn't use it again. He is therefore not included in the retention (n-day and unbounded) of the second day. But then, 182 days later, he decides to reopen the app. This action will have the effect of increasing the d2 retention 182 days later in the case of the unbounded measure.

Let's put it into practice

That's it for the theory, now it's time to put it into practice. To analyze your users' retention with Vespucci, start by creating a new story. Use the template on the left to start your exploration.

Step 0: Do you want to measure Retention or Churn ?

The question is deliberately provocative: the first parameter of the template allows you to select users who continue to use your product n-days after a target action or, on the contrary, those who stop using it after a certain period of time. Note that in the latter case you could also use a template that measures churn.

Step 1: Setup the time window.

The second parameter is quite self-explanatory: you specify the time criterion associated with your retention measurement. Do you want to measure retention at 30 days, 3 months, etc.?

Step 2: Setup the target event.

This setting deserves our attention. Up to now, we've always considered users still active n days after their first sessions on the product. This may not be the most appropriate definition. You might want to refine the basis for calculating retention. Let's say you've developed a sports tracking app. This app requires the iPhone to be paired with an Apple Watch to really work. However, after appearing on a specialized podcast, curious users download your app and arrive at the screen inviting them to share their watch's health data. It goes without saying that these users will never open your app again. They will negatively affect your retention. But was it necessary to include them? Probably not.

To illustrate how it is possible to constrain the measurement of retention, let's consider another example, adapted from a case we actually experienced with one of our customers. A social networking app faced a challenge: it was impossible to engage (and therefore retain) a user if they didn't have at least a few friends from their existing network in the app (imagine replacing WhatsApp or iMessage with an app that none of your contacts use...). So they decided to set up all kinds of initiatives and goodies in the app to encourage a new user to invite their contacts into the app. Only after a user has added 3 of these friends to the app are they included in the retention measurement. For n-day retention their metric looked like this: the percentage of users who return to their product n-days after adding their third friend to the app. It's precisely these kinds of constraints that the last frame lets you define.

Step 3: Identify the drivers.

Now we're getting to the heart of the matter. Vespucci enables you to identify the elements that increase the likelihood of your template being realized. In other words, we can help you identify the elements that will increase user retention. These elements are very diverse, and relate to questions of segmentation (e.g. do the characteristics of your users declared during their onboarding affect their retention?) of content, or even to certain actions performed by your users when using your product. To explore these elements, use the insight finder (accessible from the toolbar by selecting the brain icon in the top left-hand corner) or explore our guides.

Build the rigth taging plam.

You absolutely must have certain elements within your tagging plan to track user retention. However, some approaches are more demanding than others.

Identify your users' first session.

One approach is to create a first launch property. You'll need to define this property as a "user property" if you're using Amplitude, or attach it to an "identity" if you're using Segment. The advantage of this approach is its robustness. You don't have to go through your entire data set to find the first session of each of your users. The disadvantage is its lack of flexibility: it doesn't allow you to define the starting point of retention based on the performance of a specific action.

Event based approach.

The most obvious and flexible approach is to use the event flow of your taging plan. This allows you to calculate retention after the first occurrence of a specific action. However, this approach can be challenging, as it requires you to process and have access to all your historical data. Such an approach is even impossible to implement in certain Segment setups.

"Index" based approcah.

A final approach is an "hybrid" approach. It can be implemented in several ways. The simplest is to define the "first launch" property mentioned in the first approach on the basis of finer criteria. For example, you could track not the date of the first launch, but that of a particular, more relevant action. You could also consider implementing a more complex, but more flexible, solution based on a dictionary. The keys of this dictionary would consist of a series of remarkable properties that you would have identified beforehand, while their values would correspond to the time stamps associated with these actions