Split testing broadcasts

Split Testing Broadcasts Using Variants

Every broadcast can have any number of variants so that you can test out different aspects of a broadcast to compare their success. When a variant is first added to a broadcast, it is an exact copy of the original broadcast. It can then be tweaked to test items such as:

  • Subject
  • Format
  • Content
  • Layout
  • Attachments

To manage the variants of a broadcast, choose the Variants option from the Choose action… drop-down menu or click the number under the Variants column.

“Use variants to test various aspects of broadcasts against each other”

Once you have done so, this screen will appear:

To create your first split-test variant click on Add a variant to this message from the I want to… drop-down menu. This creates a copy of the original message as your first variant and opens up the message editor for the variant you have just created.

In the example image below, we changed the Subject line so we can split test the variant against the original.

You can change any aspect of the message. Once you have made your changes, click the Save Variant button.

You will then be redirected back to the Broadcast Variants list screen, which now shows the variant you just created.

In the image below, take a look at the Frequency column.

You can change the percentage of contacts to be sent each message using the slider in the Frequency column, as pointed out below.

The system decides at random during the sending process which message will be sent to each contact.