How does A/B test work?
In this guide, we will show you what A/B test is and how you can test your campaigns to increase your Poptin conversions.
A/B test is also known as split testing. Where you split your website traffic into two or more groups and they are shown 2 or more Poptins A & B/C equally to the different visitors on a rotational basis.
So 50% of your views are displayed Poptin A and 50% of your visitors are displayed Poptin B. Poptin, either A or B with more conversions is a winner.
Source: Devopedia
Which elements of your Poptin can be A/B tested? We can say all but below is a small list of elements that you can play around with to get the best results out of your A/B test.
Templates: A/B test can be done with different templates. Such as a Slide-In may get more conversions over Lightbox it's always a good idea to test templates to see which template works best for your business/website.
Call To Action: You can test different sizes, colors, fonts, and the button text itself to get maximum results. Tip: There should be a good contrast between your button and the background.
Images and Videos: You can try between a real picture or a product mockup as well as check whether the Images perform better or the videos. Try different images one image might be convincing while the other might not be. It's always a good idea to A/B test with the images.
Offers: You can test different offers and get to know which offers are loved most by your website visitors. Such as a Flat $5 discount, Flat 5% off on products, or free shipping. The sky is the limit here.
Triggers: A/B test your display rules as for some websites the Time Delay popup would be great but for some, an Exit-Intent would work best.
Example: Test between Time Delay 5 Seconds vs Exit-Intent Popups
If this all sounds good to you then you might be ready to A/B test your campaigns at Poptin. Check the step-by-step guide below.
Log in to your Poptin dashboard and click on Popups. Now that you are in your popups summary you can see A/B Test icon.
Once you click on the A/B icon you can then choose between the Same Template or New Template. This way you can either test 2 completely different Poptins or just different variations of the same template (poptin). For this guide, we will choose the Same Template.
Change elements that you wish to A/B test it could be a different title, image, offer, and or the Call To Action button. For this tutorial, we've changed the offer, image, and color as well as text of the Call To Action button.
Once you are done customizing click the next button to set your display rules and click publish to publish your B Poptin. We suggest keeping the same display rules to accurately measure the results, however, you can test display rules to see which trigger works best. Once published you'll now be able to see both A and B parts of your Poptins.
Your Poptin's A/B test is now live and working. Poptin A and Poptin B will randomly rotate between visitors and you will be able to identify the best performing Poptin by measuring the conversion rates.
The best part about A/B test with Poptin is that you're not just limited to Poptin A and Poptin B. You can add as many variants as you like such as A/B/C/D etc.
Note: Please keep the following points in mind when creating A/B.
When conducting A/B tests for forms, include only the code for version A to display both forms. If you plan to delete version A and display only version B, it's recommended to isolate it and install the actual code for version B.
A/B Tests are conducted per visit, which implies that every time a user accesses your website, they will encounter the same version of the popup during their entire visit. The chosen version will remain visible for any targeting option or trigger (including On-click trigger).
A/B test is also known as split testing. Where you split your website traffic into two or more groups and they are shown 2 or more Poptins A & B/C equally to the different visitors on a rotational basis.
So 50% of your views are displayed Poptin A and 50% of your visitors are displayed Poptin B. Poptin, either A or B with more conversions is a winner.
Source: Devopedia
Which elements of your Poptin can be A/B tested? We can say all but below is a small list of elements that you can play around with to get the best results out of your A/B test.
Templates: A/B test can be done with different templates. Such as a Slide-In may get more conversions over Lightbox it's always a good idea to test templates to see which template works best for your business/website.
Call To Action: You can test different sizes, colors, fonts, and the button text itself to get maximum results. Tip: There should be a good contrast between your button and the background.
Images and Videos: You can try between a real picture or a product mockup as well as check whether the Images perform better or the videos. Try different images one image might be convincing while the other might not be. It's always a good idea to A/B test with the images.
Offers: You can test different offers and get to know which offers are loved most by your website visitors. Such as a Flat $5 discount, Flat 5% off on products, or free shipping. The sky is the limit here.
Triggers: A/B test your display rules as for some websites the Time Delay popup would be great but for some, an Exit-Intent would work best.
Example: Test between Time Delay 5 Seconds vs Exit-Intent Popups
If this all sounds good to you then you might be ready to A/B test your campaigns at Poptin. Check the step-by-step guide below.
Log in to your Poptin dashboard and click on Popups. Now that you are in your popups summary you can see A/B Test icon.
Once you click on the A/B icon you can then choose between the Same Template or New Template. This way you can either test 2 completely different Poptins or just different variations of the same template (poptin). For this guide, we will choose the Same Template.
Change elements that you wish to A/B test it could be a different title, image, offer, and or the Call To Action button. For this tutorial, we've changed the offer, image, and color as well as text of the Call To Action button.
Once you are done customizing click the next button to set your display rules and click publish to publish your B Poptin. We suggest keeping the same display rules to accurately measure the results, however, you can test display rules to see which trigger works best. Once published you'll now be able to see both A and B parts of your Poptins.
Your Poptin's A/B test is now live and working. Poptin A and Poptin B will randomly rotate between visitors and you will be able to identify the best performing Poptin by measuring the conversion rates.
The best part about A/B test with Poptin is that you're not just limited to Poptin A and Poptin B. You can add as many variants as you like such as A/B/C/D etc.
Note: Please keep the following points in mind when creating A/B.
When conducting A/B tests for forms, include only the code for version A to display both forms. If you plan to delete version A and display only version B, it's recommended to isolate it and install the actual code for version B.
A/B Tests are conducted per visit, which implies that every time a user accesses your website, they will encounter the same version of the popup during their entire visit. The chosen version will remain visible for any targeting option or trigger (including On-click trigger).
Updated on: 15/11/2024
Thank you!