A/B testing offers
How to test two versions of an offer, how buyers are split, and how to pick a winner.
You can A/B test offers in pre-purchase upsells and in the post-purchase steps of a funnel. A test shows the original offer (Control) to half of buyers and a different version (Test) to the other half. You then keep the one that converts better.
What you can test
| Where | What the test compares |
|---|---|
| Pre-purchase upsell | The whole set of upsell products: your current products against a second set, or against showing nothing |
| Post-purchase funnel, Upsell #1, Upsell #2 and Downsell | One offered product against another product |
| Thank You Page step | A/B tests aren't available |
How buyers are split
- The split is always 50/50. You can't change it.
- Each checkout is assigned to Control or Test once and keeps it, so a buyer who reloads the page sees the same version.
- While a test is paused or stopped, every buyer sees the live offer.
Testing a pre-purchase upsell
- Open the upsell from Checkout → Pre-Purchase Upsells.
- Under Upsell Products, add at least one product.
- Click Create A/B Test and choose one of:
- Duplicate Content: the Test version starts as a copy of your current products, ready to change.
- New Content: the Test version starts empty, so you choose new products for it.
- Skip: the Test version shows nothing. Half of buyers see no upsell widget, and half see the original. Use it to measure whether the upsell helps at all.
- Use the Control - 50% of customers and Test - 50% of customers tabs to edit each version.
- Click Create Upsell or Save Changes to save the upsell and the test.
- Click Start. The badge changes from Not started to Running.
Testing a post-purchase offer
- Open the funnel on the Post - Purchase Upsell step.
- On the product card you want to test, click Create A/B Test.
- Enter a name under Name Your Test.
- Under Select Products, choose the product to test against the current one.
- Click Create Test. The test appears on the card with the badge Not started yet.
- Click Start.
Each product card can have its own test, so one step can run several tests at once.
Pausing, resuming and deleting
- Pause stops the test. All buyers see the live offer until you click Resume.
- On a pre-purchase upsell, Delete entire test in the test's menu removes the test. On a post-purchase card, use Delete in the test's menu.
Choosing a winner
- Click Stop.
- The version with the higher conversion rate is selected for you. Each option shows its conversion rate.
- Keep that choice or click the other version.
- Click Save winner.
The version you pick becomes the live offer for everyone. On a post-purchase card, the winning product takes the place of the tested product in the step.
The app doesn't check whether a result is statistically significant. It pre-selects whichever version has the higher conversion rate, even after only a few orders. Let a test run until both versions have had plenty of views before you pick a winner.
Where to see results
Conversion rates for each version appear when you click Stop. For more detail, see Analytics.