Skip to content
Free tool

In-app survey confidence calculator: how many responses do you need?

Estimate the number of responses to collect and the time needed to be confident in your in-app survey results, and decide better, faster.

“How many responses do I need?”

When you launch a survey, one of the first questions is: how many responses do you need to trust the results? This information is essential to avoid making decisions on biased data. This free calculator helps you estimate the number of responses and the time needed to get them.

How do you determine the sample size of an online survey?

Based on data from hundreds of companies that use Screeb, we established the following formula:

n = (statistical confidence level² × Screeb average response rate × (1 − Screeb average response rate)) / margin of error²

We set the margin of error at 5%.

This formula assumes, however, that all your respondents are random. For in-app surveys, the first people who see the survey aren't necessarily representative, so you need a larger sample for the survey to be valid.

So we combine n with the number of people you want to show the survey to, to get an estimate (r):

r = n / (1 + (n − 1) / audience size)

How long should you show the survey to get enough responses?

Knowing how long a survey needs to stay live before reaching statistical significance also helps you size your project. Here is the formula:

t = (r / (audience size × Screeb average response rate)) × 24

The calculator then shows the number of hours to wait before you can rely on your responses.

How to use the calculator

  1. Enter your work email.
  2. Enter how many people the survey will be shown to. For a generic survey (NPS, satisfaction…), enter your total monthly active users. For a tactical survey (on a specific feature), enter the number of people who use that feature each month.
  3. Choose the statistical confidence level you want for the responses: 90%, 95%, or 99%.
  4. The calculator returns the number of responses needed and the matching display time.

To collect these responses, discover in-app surveys with Voice of Customer.

Your own numbers are worth more than a market average.

In 30 minutes, see what these methods deliver on your journeys.

Shall we try it on your journeys?