LogoLogo
PlatformsPricingRessources
  • Home
  • Onboarding
  • User documentation
  • Release Notes
  • Help Center
  • Help center
  • Troubleshooting
    • [Troubleshooting] Managing multiple currencies in the campaign reporting
    • [Troubleshooting] QA a campaign with a geolocation targeting
    • [Troubleshooting] Differences between the display frequency option and the scheduler
    • [Troubleshooting] Checking why you are not assigned to a campaign or variation
    • [Troubleshooting] Reasons for differences in data between Google Analytics and AB Tasty
    • [Troubleshooting] Checking if a page is assigned to a campaign
    • [Troubleshooting] I deactivated a variation in the traffic allocation step but still see it online
    • [Troubleshooting] I can’t log in to AB Tasty
    • [Troubleshooting] Traffic modulation doesn’t seem consistent with my settings
    • [Troubleshooting] The report indicated a statistical reliability yesterday, but today it doesn’t
    • [Troubleshooting] I see the original version very briefly before I see the variation (flickering)
    • [Troubleshooting] There are differences in data between AB Tasty and my analytics
    • [Troubleshooting] Scroll tracking data in report
    • [Troubleshooting] How to avoid being assigned to a test – the optout method
    • [Troubleshooting] My modifications are not displayed
    • [Troubleshooting] How to Force the Display of a Variation?
    • [Troubleshooting] Avoiding SEO mistakes in a redirection test
    • [Troubleshooting] Why is the editor not loading and how can I force it to open?
    • [Troubleshooting] QA Assistant doesn’t load on my website
  • FAQ
    • FAQ about custom widgets
    • FAQ Sequential Testing Alerts
    • FAQ traffic allocation
    • How to Check if the AB Tasty Tag Is Installed on My Website?
    • Why AB Tasty reporting data sometimes differs from Google Analytics data
    • FAQ About the Transaction Tag
    • FAQ Widgets
    • FAQ Campaign setup
    • FAQ about prioritization
  • Get help from our Copilots
Powered by GitBook
LogoLogo

AB Tasty Website

  • Home page AB Tasty
  • Blog
  • Sample size calculator
  • Release note

AB Tasty Plateform

  • Login

© Copyright 2025 AB Tasty, Inc, All rights reserved

On this page

Was this helpful?

Edit on GitLab
Export as PDF
  1. Troubleshooting

[Troubleshooting] The report indicated a statistical reliability yesterday, but today it doesn’t

Previous[Troubleshooting] Traffic modulation doesn’t seem consistent with my settingsNext[Troubleshooting] I see the original version very briefly before I see the variation (flickering)

Was this helpful?

The most likely cause of this error is that your sample size is too small. Only predefined sample sizes that are large enough create significant differences and meaningful results. If your sample (the number of visitors tested) is too small, the test loses its value.

We recommend you calculate the sample size you need to attain using a before running a statistical test. It is also recommended to wait a few extra days before consulting your results, even if your sample size is large enough, so you can account for user behavior on different days of the week.

sample size calculator