What is the difference between an A/B test and a MVT?
About the A/B test
An A/B test allows you to make variations of one or several pages.
For instance, an A/B test can measure the performance of a product sheet A versus a product sheet B.
The disadvantage of this kind of test is that you need to change only one element per page (for example, the title of the download button) to know if this modification has an impact on the conversion rate.
Please note that you can change a multitude of elements with an A/B test but it would be impossible to know the impact of these changes individually.
About the Multi variate test or MVT
The Multi variate test allows you to change several elements of a page in order to analyze which combination converts the most.
For instance, you want to try on one A/B test your original version + 2 versions of the “Add to basket” button + 4 different titles + 4 different images and analyze which of the button-title-image combination suits the most.
If you choose an MVT, you will have 3 x 5 x 5 = 75 variations (including the original one) tested. Here is the main interest of an A/B testing solution such as Kameleoon, able to handle an unlimited number of variations and to statistically calculate which version is the more efficient.
For example, a simple MVT allows you to test the performance of these 4 buttons by creating 2 variations in the Kameleoon editor (one to change the title and one to change the color):
Note : the number of versions of a same page can quickly become important in the case of an MVT. You need to make sure to have enough unique visitors for the result to be statistically significant. For further information, you can read our article about Statistical significance.
To create your first MVT test with Kameleoon, please read our article Creating a Multi Variate test (MVT).