Compare Multiple Segments in Wingify

The report of an A/B test shows the performance of different variations for your website's overall traffic. To further analyze the test, customers often use report filters to view data for a particular visitor segment. In Wingify, you can view a comprehensive report that allows you to compare two or more visitor segments in the same report.

For example, if you want to view the conversion rate of visitors from mobile and desktop, rather than opening them individually, you can now compare them. With this capability, you can add segments from Standard Segments, My Segments and even include one custom segment to the comparison.

Comparing multiple segments in a Wingify test report enables you to visualize the subsets of your data in a single view. For example, your test might show that the variation in your test increases the conversion rate by 5%. Still, when you compare this number for new and returning visitors, you find that returning visitors like the original version better while new visitors appreciate the change. Or there could be a scenario where the test conversion rate is 2%. Still, when you segment your report on different traffic types- direct, referral, and social, you find that the conversion rate from referral traffic is 8%. In contrast, for social and direct, it is 0.2% and 0.4%, respectively.

To compare segments in Wingify, you must choose two or more segments from the following sections- Standard Segments, My Segments, or Custom (to define a segment with specific attributes such as visitors landing on your page at a particular hour of the day). You can compare segments based on different criteria. Some examples of comparing criteria could be:

1. Traffic Type - Direct, Referral, etc.
2. Browser - Chrome, Safari, Firefox, etc
3. Device type - Desktop, Mobile, and Tablet

Some answers that you can get using compare segments in Wingify

• How different variations perform across segments,
• What is the improvement of a variation over baseline across segments,
• What is the overall conversion rate of each segment,
• What is the overall size of each segment (say by traffic type - direct, referral, social, etc.) in the test?

Wingify also allows you to compare multiple segments and multiple goals/metrics (if your workspace is enabled with Data360) in the same view. This adds a new dimension to the report, as shown in the screenshot below.

Things to Consider While Working with Segment Comparison in Wingify

1. Currently, we display the stats in a table only. We will introduce a graphical comparison in future releases.
2. When you select a segment for comparison, the All Visitor segment gets selected automatically. You can remove it from the comparison as well.
3. At a time, you can only include a single custom segment for comparison; however, you can add multiple conditions in that custom segment. To apply multiple custom segments, you can save them as My Segments and compare them.
4. You can use the view settings option to change which metrics are shown in the table and to hide total row and disabled variations from the table.
5. This feature is available in the A/B test, Split URL test, Server-side A/B test, and Feature test.

Activating Segment Comparison in Wingify

To compare segments in Wingify, perform these steps.

1. Log in to your Wingify account.
2. From the panel on the left, go to Web Experimentation, and open your campaign.
3. Go to the Reports tab.
4. From the filters section, click on the Visitor Segments dropdown.
5. To activate the segments comparison in Wingify, select the compare checkbox corresponding to the segment.
   
   Note:
   1. As soon as you select a segment, the All Traffic segment also gets selected by default. To remove any segment from comparison, click on the cross icon with the selected segments at the top of the segments list. 
   2. You can select any number of segments for comparison.
6. To view the report, click Compare.