Campaign reporting
Last updated
Was this helpful?
Last updated
Was this helpful?
A reporting is a single and unique page that is generated for each campaign you execute with AB Tasty, whether that’s a test or a personalization campaign. The reporting is a valuable tool that assists you in making decisions to increase your conversion rates.
You can access the reporting by clicking on the reporting button on any campaign in your Web experimentation or Personalization list.
The green button indicates that the campaign has enough data to be fully analyzed
The yellow button indicates that the campaign does not have enough data to fully analyze the primary goal.
A campaign reporting is composed of the following information and components
The reporting header shows when the campaign was created and for how long it has been live. It also indicates the total number of unique visitors on the campaign.
You can also trace back any modifications done to the campaign from the Open campaign history button.
The reporting shows by default a monitoring graph of the Primary goal
Users can switch between Day to Day and Cumulative graph views. This is particularly beneficial for users who wish to monitor the stabilization of conversion rates over time at the goal level.
Day-to-day view:
Cumulative view:
The graph switcher enables toggling between these views, with "Day to Day" as the default. The cumulative graph displays conversion rates accumulated over time, providing insights into long-term trends.
The availability of the cumulative graph depends on the selected data perspective: it is unavailable when Sessions is selected, but available when Visitors is chosen.
The cumulative graph can display data for up to 45 days, with a maximum of six variations, and users can interact with the graph to view detailed conversion statistics by hovering over the lines. Additionally, users can customize the displayed period using a date-picker, ensuring the graph reflects the desired timeframe.
You can select from either Unique visitors or Unique sessions for both the Original and variation(s) for the Primary goal of the campaign. Conversion rates are also graphed.
The comparative graph is based on all goals and show the number of Unique visitors per goal.
Both graphs can be customized using the following filters:
Select a date range
Select goals to compare
The primary goal is also displayed in table view. The table view shows the name of the Primary goal and the type of tracking used. The table view also allows you to sort data and export them. The data can be viewed generally by either Visitor or Session. However, the options available will depend on the type of metric chosen.
The Variation Name column width can also be adjusted to ease reading. The Variation ID can be copied to the clipboard by clicking on it.
You can choose the type of metric view you want for each goal. The metric available depends on the type of goal tracking used.
The following data can be visualized in the table:
Growth: indicated by trending arrows
Chance to win
Confidence interval
Opportunities
Revenue uplift (for transaction goals)
Below are a few examples:
Opportunities aim at identifying losing, neutral and winning status. Two subviews are available out here :
highlights : list sure opportunities out of the following rules :
Winner : chance to win above 95%, AND owns more than 5000 visitors and owns more that 300 conversions (rules worth whatever it is filtered / segmented or not)
Looser : chance to win under 5%, AND owns more than 5000 visitors and owns more that 300 conversions (rules worth whatever it is filtered / segmented or not)
Best practices : Ideally the campaign ran more than 14 days in a raw before you make decision
Detailed view : list all the variations’ performances with detailed metrics
Horizontal bars in the opportunities column indicate:
How big is the growth: Length of the bar
Positive growth of conversion: head right
Negative growth of conversion: head left
How statistically valuable they are : - Red : sure loser - Grey : neutral - Red : sure winner
The view includes several columns for in-depth analysis and is sorted by audience size by default.
Bounce rate:
The color logic is inverted for bounce rate. The higher the bounce rate, the lower the change to win.
The following screenshot shows a low bounce rate (trend arrow going down) but green.
The default table view displayed when the reporting is open.
The statistics view shows the growth, chance to win and Confidence Interval:
Growth: Probability that visitors will perform more tracked actions compared to baseline
Chance to win: Probability that visitors will perform more tracked actions compared to baseline
Confidence interval: Indicator that assures (with 95% confidence) that the variation growth rate will be between the lower and upper bounds if all traffic is allocated to the variation. The median value indicates the most probable growth rate
These segments show performance based on growth and chance to win. Segments on the right indicate strong performance, while those on the left indicate weaker performance. The length of a segment correlates with the amount of growth: longer segments on the right signify greater growth, and longer segments on the left signify lesser growth. Green segments denote the highest probability of success, whereas red segments indicate the lowest probability of success.
When enough data has been gathered for the campaign, the CAMPAIGN READY status is displayed on the table. Hovering it will give you a quick summary of the campaign and its Readiness.
Cell Values in Reporting tables
When reviewing a reporting table in AB Tasty, you may encounter three types of cell values:
Figures
This represents an aggregated figure related to your metrics or statistics. A value of "0" is a possible figure and should be interpreted accordingly.
N/A (Not Available)
This indicates that the figure is intentionally not provided for that cell. This usually occurs because the campaign configuration doesn't allow for analysis.
Example: If there is no traffic allocated to the original variant, metrics like "Chances to Win," "Confidence Interval," and "Growth" can still be calculated, but their values are not meaningful. In such cases, comparing the performance of two variants is not possible if one variant has no traffic.
No Data
If you encounter this value, try reloading the reporting page. If the issue persists, please contact your Customer Success Manager (CSM).
The secondary goals are listed just after the primary goal table view and offers the same features as the primary goal table view.
You can now access and view campaign reporting and full analysis of your data.
The Custom Views feature allows you to personalize your reporting experience by creating and selecting the metrics most relevant to your needs.
You can switch to different views by clicking on the labelled views button, on top of the table.
Click on the edit icon to manage your metric views. You can add or remove metrics, as well as create new views. You can also select which view is displayed by default for each goal at your user level.
When having one or multiple variations, you can choose a baseline to which your data will be compared. By default, the baseline is set to the original website. However, you can set it to any variation.
To change the baseline, select any variation from the Baseline drop-down list in the reporting header.
This will set the baseline indicator to the variation you chose and compare data to it.
The reporting can also be shared to non AB Tasty users and will be available for 30 days.
Next, click on Create link
The Reporting data update frequencies are as follows:
Campaign Live
Frequency
Up to 12 hours or 1,000 unique visitors (Real-time reporting)
Every 5 minutes
Up to 72 hours
Every hour
4 to 7 days
Every 4 hours
8 to 14 days
Every 8 hours
15 to 30 days
Every 24 hours
31 days to 60 days
Every 48 hours
61 days and more
Every 168 hours (1 week)
Any live reporting that would not have been open for 30 days is not updated anymore until it is reloaded.
User who subscribed to the EmotionsAI feature can apply EmotionsAI filter templates on the reporting:
To learn more about using EmotionsAI filter templates, read .
To learn more about the analysis process, read more on the
Refer to article for more details
Data can be exported. You can either export the Reporting data or the Raw data. The Reporting data export contains only data displayed in the reporting whereas the Raw data export contains hits for all types of goal. For more information on data export, please refer to .
To learn more about campaign goals, read
To learn more about advanced features of the reporting, read
To share the reporting, click on the Share reporting button in the reporting header.
