Using A/B Tests In Workflows

A/B testing helps validate hypotheses and understand the preferences and behavior of the target audience

Built-in functionality allows testing:

Using workflows, you can test the effectiveness of various elements of triggered messages, such as text, calls to action, images, or sending via different channels.

Use the Split block from the Conditions blocks for split testing.

Split block

Let's consider an experiment using the example of an abandoned cart:

  • The first message contains a discount on items abandoned in the cart:
Message contains a discount
  • The second message contains a timer with a countdown until the end of the discount.
Message contains a timer

The goal of this test is to check whether a timer counting down the time until the end of the promotion influences the purchase decision.

Creating a Workflow for Testing

  1. Go to Triggers → Workflows, and click the New workflow button.
Creating a workflow
  1. Enter its name and tags (optionally).
New workflow
  1. By default, the Start block already starts the workflow. Then add blocks:
  • Split, where contacts are automatically distributed between workflow branches 50/50. To change the ratio, drag the slider in the block settings to the left or right.
Split block settings
  • Email for A and B branches; select the message in the block parameters.
Email block settings
  • End.

The workflow will look like this:

Workflow
  1. Click Save and exit

After launching the workflow, the system will randomly distribute contacts between two branches in a 50-50 ratio. Each contact will receive only one message, according to the branch they fall into.

Setting Up Workflow Launch and Checking Results

  1. Go to Triggers → Workflows and click Start/Stop configuration in the field of the created workflow.
Launch conditions
  1. Enable the Start Configuration slide button, select Regular, and a dynamic segment for the campaign.
Start Configuration
  1. Configure launch conditions and click Apply.
  2. Activate the workflow.
Activate the workflow

Later, you will be able to check and compare the test results.

To do this:

  1. Click three dots in the field of the created workflow and select View campaign report.
View campaign report
  1. Choose a period and compare the indicators for each message.
Compare the indicators