How to calculate AB test sample size and duration for statistical significance using the Bayesian Calculator | Scribe

    How to calculate AB test sample size and duration for statistical significance using the Bayesian Calculator

    1
    Navigate to [https://marketing.dynamicyield.com/ab-test-duration-calculator/](https://marketing.dynamicyield.com/ab-test-duration-calculator/)
    2
    Get your current state data ready. Input the current conversion rate for whatever you're trying to optimize in this field
    3
    Input your expected uplift in the next field e.g. if you're hoping to achieve a 20% statistically significant lift in your experiment, write 20% in this field
    4
    Specify how many variations you'll have in your test INCLUDING your Control variant
    5
    Finally, specify how many samples you typically get per day (i.e. expected traffic). This should be total expected traffic, not expected traffic per variant
    6
    Click "Calculate"
    7
    Your sample size and duration estimate will appear in blue in this section here based on a 95% confidence level (generally accepted to be synonymous with "stat sig")
    information ordinal icon
    Tip! You can adjust the numbers in the fields to do some sensitivity analysis i.e. if you reduce the expected uplift, then you'll also see you'll need a longer duration for you experiment to hit stat sig