Reporting & Analysis
Understanding our reporting and analysis features
Reporting Interface
Getting experiment analytics and insights
Reporting screenHow to navigate and use the reporting screen
Reporting toolbarWhat options does the reporting toolbar give you?
Test overview and summaryWhat information do the test overview and summary section give you?
Metric tableWhat information does the metric table show?
Statistics Engine
The calculations that power the reporting in Optimize
Stats Engine
Mann-Whitney U-Tests / Wilcoxon Rank Sum TestA non technical explanation of t-tests
Z Tests in Webtrends OptimizeA non technical explanation of t-tests
Taguchi/Fisher method for design of experiments in MVT'sA description of the methods used when reporting for MVT's
Multi Armed Bandits (MAB) - The Theory
Understanding False Discovery RatesHow to analyse statistical significance, confidence intervals and chance to beat control on AA and AB tests
Understanding the data
How to interpret the results in the reporting screen
Understanding bot traffic
Engagement Rate | Bounce Rate