Skip to main content

Reporting screen

How to navigate and use the reporting screen

James Harber avatar
Written by James Harber
Updated this week

Overview

The reporting screen shows results for the specific test you are viewing it for. This includes information relating to the test itself such as audience and set-live date but also data relating to the performance of the test itself.

If you are looking for guidance on a SRM (sample ratio mismatch) please read this guide.

Reporting toolbar

The reporting toolbar has all the essential settings and preference options as well as sharing and exporting functions. Once you set things here they will be reflected in the reports shown below.

Report dates

Using the date selection you can select a finite date range to show data for. There is no limit on how much data you request.

Conversion points

Here you are selecting the conversion points you want to see in the test results. You are also able to change the order they are shown here.

Selecting conversions dictates how the rest of reporting is shown, e.g. selecting 3 conversions points, of a possible 5, would reflect in all stats including the graphs.

Dimensions

Dimensions allow you to lay the data out differently within the report focussing on differences in behaviour between different attributes such as device, browser or location. You are also able to change the hierarchy of the report meaning you can define the layout to best suit what it is you are trying to see.

This is a great way to compare device performance, and likely the quickest.

Select device here and you will see a breakdown in your reporting as follows:
​

Filters

Filters allow you to include/exclude certain segments or audiences from the data you are viewing. You can create nested/non-nested filters, use and/or as well as being able to match all rules or match any giving ultimate flexibility.

Settings

Within settings you can change the core way in which the report works. You can define different ways of counting data such as users vs. sessions. You can also adjust the confidence level (which helps define statistical significance of something).

Confidence

Changing the confidence will dictate how easily something can be classed as significant. It does not relate to chance to beat control and is a separate calculation done in the background. This setting is user based and only reflects on the experience that user is viewing.

Control group

Changing the control group will change which versions is compared as the control in the experience itself. It is only doing this in the reporting and is not changing the experience itself.

Users/Conversions - scope

Changing the scope will change the way we show conversion and view's data. This works as below:
​

Export/download

You have options to download and export the results of your tests. Your options are to download the metric table as it appears (with tabs for each section) or to download the raw data which sits behind the reporting screen.

Share

You have multiple options to share using this share icon. You can share reports with people even if they do not have a login for Webtrends Optimize and you can choose whether to maintain this with live data or just a snapshot of the current data you are viewing.

Choosing live data means this link will be active for the selected days and anyone accessing it via that link will be able to see real-time data.

Test overview/summary

The test overview will show you the details of the test such as when it was set live, what audience it is targeting and whether there was any throttling applied. The test summary gives an overview of the overall performance of the test. It allows you to efficiently understand how each metric, conversion or goal performed and highlights the 'winning variation'. There are also graphs showing traffic volumes over time as well as stabilisation and funnel views.

Metric tables

The metric tables give a full breakdown of the performance of all metrics for all variations. The tables are broken out by data type and also view type where you can view data by day or week as well as in funnel view.

Did this answer your question?