How to use A/B and Multivarient Test Emails

When you are exploring the most effective ways to garner a Prospect's interest in your business, email performance is key. Knowing what techniques your customers will respond to can help you decide how to structure future content. 

Plans

A/B Test Emails are available to users on all plans. Multivarient Test Emails are available to users on Professional and Enterprise plans.

How do they work?

A/B and Multivarient Test Emails allow users to send different versions of an Email to different groups of Prospects with the goal of understanding what draws a Prospect's attention most effectively. 

An A/B Test Email allows you to test one variable, like the subject line or send time. Learn more.

A Multivarient Test Email allows you to test up to three variables in a single email test campaign. Learn more.

How to create an A/B Test Email

  1. Go to Emails. In the upper right corner of the page, click the dropdown on the New Email button.
    AB1.png
  2. Select New A/B Test Email.
  3. Enter the recipient information, then click Next.
  4. Select a variable to test.
  5. Use the plus and minus symbols to set the number of different variations of the variables, up to three.
  6. Use the slider to determine the percentage of Email recipients that should receive an alternate test combination.
    Then, select how the winner should be chosen and how long after the Email was sent to decide. Click Next.
    AB6.png
  7. Fill out the Email Setup information. Click Next.
  8. Select the Email Templates you will send to Prospects. Click Next.
  9. Review the Summary, then click Next to finish.

The winner of the test Emails will appear in the Details tab of the record. If you want to review the results of the test emails, go to the Statistics tab of the Email record and use the Combination dropdown to see how each set of variations performed.

If no winning criteria is met within the test period, the very first combination will be declared the winner and the winning segment will receive that Email.

How to create a Multivarient Test Email

  1. Go to Emails. In the upper right corner of the page, click the dropdown on the New Email button.
  2. Select New Multivariate Test Email.
  3. Enter the recipient information. Click Next.
  4. Select up to three different variables to test.
  5. Use the plus and minus symbols to set the number of different variations of the variables.
    AB11.png
  6. Use the slider to determine the percentage of Email recipients that should receive an alternate test combination. We recommend at least 5,000 recipients per combination to have a statistically significant sample size.

    Click Next.
    AB12.png
  7. Fill out the Email Setup information. This is where you will enter the information for the Subject Line, From Name and Address, and/or Email Send Time. Click Next.
  8. Select an Email Template or select multiple Templates if you selected the Content variable. Click Next.
  9. Review the Summary, then click Next to finish.

The winner of the test Emails will appear in the Details tab of the record. If you want to review the results of the test emails, go to the Statistics tab of the Email record and use the Combination dropdown to see how each set of variations performed.

If no winning criteria is met within the test period, the very first combination will be declared the winner and the winning segment will receive that Email.

Was this article helpful?