[NEW] Results page settings

The Results page offers tools and configuration options to customize how Kameleoon displays your experiment data. You can control date ranges and apply filters to refine results, facilitating trend identification and actionable conclusions based on relevant data.

Date controls

The Overview, Metrics, and Compare sections feature a toolbar to adjust the time range for data on the Results page. It’s important to note that the selected time range applies to all data on the page for a consistent view of relevant information.

To change the data’s time range:

1. Click the Calendar icon.
2. You will have several options to customize the date range:
   • Fixed:
     • Enter a start date and an end date into the appropriate fields, or select the dates manually on the calendar.
     • To specify a precise time, click the Clock icon to set an hour.
   • Since:
     • Enter a date to display data from that point onward.
   • Last:
     • Enter a number and choose a unit (Days, Weeks, or Months) from the dropdown to display data from the last X number of days, weeks, or months

You can also choose preset time ranges for quick selection:

• All time: Data collected since the start of the experiment.
• 30D: Data from the last 30 days.
• 7D: Data from the last 7 days.

Settings sidebar

To access the settings sidebar, click the double sideways chevrons on the right side of the page.

The sidebar contains two tabs: Audience and Data.

Audience

The Audience tab lets you filter and breakdown the audience data that Kameleoon analyzes and displays on the Results page.

Filter audience

To apply filters to your audience:

1. Click the chevron to expand the Filter audience menu, then click +Add filter.
2. Select your desired filter and specify its criteria.
   • You can use the search bar to find filters.
3. Click Apply to apply the filter.

Click Cancel at any time to return to the sidebar’s main menu.

The available audience filters are:

• Device type: Include or exclude visits/visitors based on their device type (mobile, tablet, desktop).
• Custom data: Include or exclude visits/visitors based on their associated custom data.
• Visitors: Only show new or returning visitors.
• Converted goals: Include or exclude visits that converted on your selected goals.
• Browser: Include or exclude visits/visitors based on their browser.
• Visited page URL: Include or exclude visits/visitors that visited a specific URL during their session.
• Acquisition channels: Include or exclude visits/visitors depending on the method they used to navigate to your website.
• Traffic type: Includes or exclude visits/visitors based on the type of traffic source that brought them to your website.
• Operating system: Include or exclude visits/visitors based on their operating system.
• Kameleoon segment: Include or exclude visits/visitors based on the Kameleoon segment to which they belong.
• Page title: Include or exclude visits/visitors from a certain page.
• Number of pages viewed: Include or exclude visitors who viewed more than, less than, or exactly a certain number of pages.
• Ad blocker: Include or exclude visitors using an ad blocker.
• Landing page URL: Include or exclude visits/visitors who land upon a specific URL on your website.
• Weekday: Include or exclude visits/visitors that occurred on certain weekdays.
• Time spent on the website: Include or exclude visits with a duration of more than, less than, or exactly a certain number of seconds, minutes, or hours.
• Weather: Temperature: Include or exclude visitors exposed to temperatures higher than, lower than, between, or equal to a certain number of degrees Celsius or Fahrenheit.
• SDK: Include or exclude visits/visitors collected from specific SDKs.
• Key pages: Include or exclude visits/visitors from certain key pages.
• Browser language: Include or exclude visitors based on their browser’s language.
• Weather: Sky condition: Include or exclude visitors based on the sky conditions in their area.
• Time elapsed since last visit: Include/exclude visits that lasted more than, less than, or equal to a certain number of seconds, minutes, or hours.
• Day or night: Include/include visits depending on if they happened at day or night.
• Referring website URL: Include or exclude visits/visitors based on the URL of the website that referred them to your site.
• Number of visits on the website: Include or exclude visitors with more than, less than, or exactly a certain number of visits on your website.

Note: Currently, you can only combine filters with the AND boolean.

Note: Some filters require Hybrid experimentation to function correctly. For more information, read our documentation on Hybrid experimentation.

Breakdown audience

To breakdown your audience:

1. Click the chevron to expand the Breakdown audience menu, then click +Add breakdown.
2. Select your desired breakdown and specify its criteria.
   • You can use the search bar to find breakdowns.
3. Click Apply to apply the breakdown.

Click Cancel at any time to return to the sidebar’s main menu.

The available audience breakdowns are:

• Device type: Break down visitors based on their device type.
• Custom data: Break down visits/visitors based on custom data.
• New or returning visitors: Break down new or returning visitors.
• Conversions: Break down visits/visitors based on conversions.
• Browser: Break down visitors based on their browser.
• Visited page URL: Break down visits/visitors based on a specific visited URL.
• Acquisition channel: Break down visits/visitors depending on the method they used to navigate to your website.
• Traffic type: Break down visits/visitors based on the type of traffic source that brought them to your website.
• Operating system: Break down visitors based on their operating system.
• Kameleoon segment: Break down visits/visitors based on the Kameleoon segment to which they belong.
• Page title: Break down visits/visitors from a certain page.
• Number of pages viewed: Break down visitors based on how many pages they viewed.
• Cross experiments: Break down visit/visitor data from multiple experiments.
• Cross features: Break down visit/visitor data from multiple features.
• Cross personalizations: Break down visit/visitor data from multiple personalizations.
• Ad blocker: Break down visitors based on whether they use an ad blocker.
• Landing page URL: Break down visitors who land upon a specific URL on your website.
• Day of the week: Break down visit/visitor data from specific days of the week.
• Workday and weekend: Break down visit/visitor data from the workday and weekend.
• Time spent on website: Break down visit/visitor data based on the time spent on your website.
• Browser language: Break down visitors based on their browser’s language.
• Weather: sky condition: Break down visitors based on the sky’s condition in their location.
• Time elapsed since last visit: Break down visitors based on the time elapsed since their last visit to your website.
• Day or night: Break down visits based on whether they occurred during the day or night.
• Weather: temperature: Break down visitors based on the temperature in their location.
• Number of visits on website: Break down visitors based on their number of visits on your website.
• Referring website URL: Include or exclude visits/visitors based on the URL of the website that referred them to your site, grouping results by domain or exact URL.
• SDK name: Break down visits/visitors collected from specific SDKs.

Note: Some breakdowns require Hybrid experimentation to function correctly. For more information, read our documentation on Hybrid experimentation.

Data

The Data tab lets you configure the settings for the Results page, advanced settings, and the statistical method.

Settings

Click the chevron beside Settings to expand the settings menu.

In the menu, you can:

• Show data per visit or visitor: Visit-level data counts each session separately, while visitor-level data aggregates all sessions for a unique user.
• Show conversion data per converted visits or all conversions: Converted visits count sessions with at least one conversion, while all conversions count the total number of conversions across all sessions.
• Select which variation will be used as a reference: Kameleoon compares all other variations to the reference variation and uses the reference to calculate the improvement rate.

Click Apply to save your changes.

Statistical method

Click the chevron beside Statistical method to access the statistical method menu and advanced settings.

You have three statistical methods to choose from:

• Frequentist
• Sequential testing
• Bayesian

Each method has its strengths and weaknesses. Read our statistical paper for more details.

Click Apply to save your changes.

Advanced settings

In the advanced settings menu, you can enable:

• Multiple Test Correction: Ensures accurate results when performing multiple simultaneous tests. This option is only available if your test has more than one variation.
• CUPED (controlled-experiment using pre-experiment data): Minimizes data volatility by offsetting variance from external factors, providing a more precise estimate of your variations’ influence. Enabling CUPED updates the values for conversion rate, reliability, and confidence intervals, but it doesn’t affect graphs, revenue metrics, or other related data.