A/B test statistics

When the A/B tests has been running for long enough, you can analyze the statistics for each variant. If one of the variants performed exceptionally well, you can export its settings to the base variant.

  1. To preview the A/B test statistics, go to AI Search iconAI Search > A/B tests.
  2. From the list, select the A/B test.
  3. Click the Statistics tab.
The preview of A/B test statistics
The preview of A/B test statistics
Data Description
Users The number of customers assigned to a variant.
Searches The total number of searches performed through the index.
CTR The ratio of clicks to the displayed results in the search for an index variant.
Conversion The ratio of clicked search results to those which were clicked and ended up with a purchase.
Revenue per customer Revenue generated by a variant divided by the number of customers allocated to the variant.
Clicks The number of clicked results of the search for an index variant.
Suggestions used The number of times a search suggestion was used in an index variant.
No result searches The number of times a search returned “no results”.
😕

We are sorry to hear that

Thank you for helping improve out documentation. If you need help or have any questions, please consider contacting support.

😉

Awesome!

Thank you for helping improve out documentation. If you need help or have any questions, please consider contacting support.

Close modal icon Placeholder alt for modal to satisfy link checker