Components affected: UI Visual Editor, UI Dashboard, Reporting, Scheduled Job Service,
Delivered to production: 03 Jan 2024
What's changed in the Optimize platform with Release 69? Here are the highlights.
Multi-armed bandit controls
Type: New feature
Optimize now has UI controls, allowing you to toggle between manual traffic allocation between your variants and system-driven suggestions.
When manually controlled, you will decide what split to apply to your variations - e.g. 50/50.
When system controlled, i.e. with Multi Armed Bandit enabled, we will allocate the traffic based on the Change To Beat All calculation for your Key Metric.
Future iterations of this will focus on expanding the algorithms available for MAB.
Read more: Using Multi Armed Bandits
Multi-page Testing in the Visual Editor
Type: New feature
Optimize now allows you to scope your transformations to pseudo-locations in the Visual Editor.
Previously, you were able to test across multiple pages e.g. "all PDPs" or "sitewide minus checkout", but could not scope particular changes to particular pages. For example, you may want to transform a particular banner on a homepage, and a completely different banner in a different location on PDPs.
This release introduces the ability to do this - picking a group of pages to apply your changes to at any given time, and changing this freely as you wish.
Read more: Multi-page Testing in the Visual Editor
Public sharing of reports - shorter URLs
Type: Enhancement
A recent release introduced the ability for users to share their reports publicly - with people who are not users of the Optimize platform or those who do not need to be logged in. This could either be a moment-in-time report with frozen data and filters, or a live view.
One reported piece of feedback was that the generated URLs were too long, and so hard to use on certain browsers especially the more filters/options you specified.
This enhancement drastically reduces the URL length, making these public reports far friendlier to use and less prone to faults when being shared.
Read more: Public sharing of reports
Metrics Triggered filtering
Type: Bugfix
As reported by users and explored by our team, filterng by Metrics Triggered did not behave in the way users expect, particularly when multiple rules were used in a filter together e.g. Metric A was triggered AND Metric B was triggered.
We have conducted a full regression of this area and made sure the rules are correct in line with our expectations.
Incorrect session counts on Dashboard
Type: Bugfix
We noticed that for some users, the session usage counts on the dashboard were not accurate to within your contract dates. This has been corrected.
Dashboard carousel conversion selector
Type: Bugfix
The dropdown to filter your dashboard summary panel metrics was broken. It's not anymore.