A/B test statistics
When the A/B tests has been running for long enough, you can analyze the statistics for each variant. If one of the variants performed exceptionally well, you can export its settings to the base variant.
- To preview the A/B test statistics, go to AI Search > A/B tests.
- From the list, select the A/B test.
- Click the Statistics tab.
|Users||The number of customers assigned to a variant.|
|Searches||The total number of searches performed through the index.|
|CTR||The ratio of clicks to the displayed results in the search for an index variant.|
|Conversion||The ratio of clicked search results to those which were clicked and ended up with a purchase.|
|Revenue per customer||Revenue generated by a variant divided by the number of customers allocated to the variant.|
|Clicks||The number of clicked results of the search for an index variant.|
|Suggestions used||The number of times a search suggestion was used in an index variant.|
|No result searches||The number of times a search returned “no results”.|