A split test is any situation in which you want to measure the effect of your content. Services such as Bit.ly, Argyle Social, and many other shorteners provide you with nearly everything you need to conduct an effective, statistically valid test. Let’s look at how you might deploy one using Twitter.
First, design your links. We’re going to use my blog’s Twitter welcome page as an example. I need to have four different tweetable links that track separately. I’ll start by feeding the welcome page to Google’s URL builder to ensure correct GA tracking.
This first tweet will be tagged dmwelcome1. I’ll set up four of these URLs:
Next, let’s feed each to Bit.ly so that we get a nice clean link for tweeting.
For this experiment, I’m going to set up a series of four direct messages on Twitter. You don’t have to use automatically sent direct messages. This methodology works for Facebook pages, public tweets, Google+ posts – anywhere that you want to test the same destination content with different hooks to try to bring in new eyeballs. I am using auto-DMs mainly because I can get a fair number of responses very quickly. Think outside the box!
Here’s the four tweets I’ll load up:
- Thanks for following me. If you’d like to get to know me better, visit: https://bit.ly/cpdm-1
- Thanks for following me. If you’d like to learn more about me, visit: https://bit.ly/cpdm-2
- Thanks for following! Get to know me better here: https://bit.ly/cpdm-3
- Thanks for following me. Learn more about me here: https://bit.ly/cpdm-4
Now we’re ready to test out this four way split. Obviously, you can substitute any content you like, such as calls to action to sales and other things of interest. We’ll load each of the tweets into TweetAdder:
And we’ll dispatch 200 tweets (Twitter wisely imposes a hard limit of 250 DMs a day).
Now we watch and wait as the test goes out, looking at two things:
- Which of the four tweets was most appealing to people as measured by clickthroughs using Bit.ly?
- Which of the four tweets was most in sync with my site’s content as measured by Google Analytics conversions to newsletter subscribers?
Setting up your own four way, eight way, or however many way test using these freely available tools is just as straightforward. One suggestion I’d offer is to add in a fifth message, a control, that you tweet out in public and compare it to see how private versus public messages works for your audience.
Take this recipe, this methodology, and apply it to your own marketing to see how impactful it is.
You might also enjoy:
- Understand the Meaning of Metrics
- Transformer les personnes, les processus et la technologie - Christopher S. Penn - Conférencier principal sur la science des données marketing
- How To Set Your Consulting Billing Rates and Fees
- Marketing Data Science: Introduction to Data Blending
- Retiring Old Email Marketing Strategies
Want to read more like this from Christopher Penn? Get updates here:
Get your copy of AI For Marketers
Brilliant. And trying it out now.
We ran a simple test on LinkedIn a couple weeks ago, testing a variety of headlines, subject lines and links. Still tracking…test and learn, test and learn.