Digital Marketing, Small Business Strategist

Confident Marketer

  • Home
  • Get Started
    • Build Your Business Plan
    • Organize Your Marketing
    • Prevent Overwhelm
    • Gain Confidence
    • Products
  • Consulting & Coaching
    • CEO Circle Community
    • Business Consulting
    • One Time Consultation
  • Sue’s Blog
  • About
    • About Sue Painter
    • Testimonials
    • Leave A Testimonial
    • Media
    • Speaking
  • Contact
You are here: Home / Marketing and Business Development / Easy Split Testing For Small Business Owners

Easy Split Testing For Small Business Owners

May 2, 2012 by Sue Painter 15 Comments

I was in Florida just about to indulge in my favorite food of all, the delectable stone crab claw. The ocean waters lapped up against the edge of the pier where I sat, and pelicans were busy soaring and swooping a few feet away.

Suddenly I noticed that the upright poles of the pier, which had pencil-pointed ends sticking up into the sun, were all tipped in white paint on the left side of the dock. But on the right side of the dock they were all painted black. What kind of secret signal to the boaters arriving by water for their stone crab is that, I wondered? Maybe sail boats on one side, motorized craft on the other? Maybe personal craft on one side and commercial fishing boats on the other?  I’m not a boater, so I couldn’t read the secret pier-pole language. I watched the pelicans strut up and down the docks and dive for fish while I thought about it and waited for my stone crab to land on my table.

Split testing is like those white versus black-tipped dock poles. Let’s say you write a sales letter inviting your customers to purchase a product from you. The elements of the sales letter include the title, the sales copy, the price point of the offer, and a picture of the product sitting on a shelf. But you wonder if the sales would be higher if you changed the sales letter around a little bit, so you develop a second version of it. In version B you keep all the elements the same except the picture – you change the picture to show someone actually using the product instead of it sitting on the shelf. You sit and wonder which version to use – A or B. Suddenly, you decide to divide the list of customers you’re going to send the sales letter to in half, and you send version A to half and version B to the other half. And you track the numbers – which one has better open rates and which one results in more sales? You’ve just done split testing.

Split testing is when you use two versions of an offer, split your customer list, and see which version does best for you. This is also sometimes called A/B testing. Version A of the offer versus version B. There’s a rule of thumb in split testing that you only change ONE element of the sales letter at a time. Why? Because, if version B does better than version A you want to know why. And if you change more than one element you don’t know why. Let’s say you changed the picture AND the title. Oh no! Was it the picture that caused the better response, or the different title? If you made the mistake of changing more than one element in version A versus version B, you have no way of knowing.

Lately, there is a new philosophy that is starting to crop up in marketing that says “let’s have two completely different versions and change several elements at a time. Who cares what the element was that performed better anyway? Whichever sales letter does better, why do we care why? We just drop the underperformer and go with the top performer.” This topic came up at a conference I was attending a few weeks ago – who cares which element made the difference? Strictly speaking, from a corporate marketer’s perspective, you are trying to “prove” and quantify what you do to put numbers on it – because corporations look all the time at their marketing costs and seek to contain them and scientifically get the most bang for their buck. From a small business owner’s standpoint, though, you do sales letters all the time, and you may just want to try two totally different ways of putting an offer out there. You are curious which does better for you but maybe you don’t care so much about exactly why.

But just to be clear, pure A/B testing (or split testing) means that you change only one element in your two different versions so that you can definitely say to yourself, “Ha! That picture that showed the person actually using the product sold twice as many as the one that showed the product sitting on the shelf!” You know exactly what made the difference so that you can replicate it and do it again with success.

So, you may be asking, what does all that have to do with my favorite stone crab claws and the black versus white paint on the tips of the pier poles? Well, you know I’m a curious person. I just about couldn’t stand not knowing what those black versus white tipped poles were secretly signalling to boaters. What if I arrived by boat next time I lusted for those delectable stone crab claws? So when my platter of claws arrived I sheepishly asked the server what those poles meant to the boaters. She laughed and said, “It’s not secret boating language. We were testing out if black tips on the poles would keep the pelicans from perching there any better than white paint on the poles. But it doesn’t matter. Pelicans are going to perch on pier poles no matter if the tips are black or white. Pelicans do what pelicans do – they perch on poles.”

There you have it – the stone crab place was doing a split test. They had version A and version B of pier poles – and that paint color was their only difference. All the poles where the same height. All the poles had pointed ends. The only difference was the paint on the pointed end. The pier poles were a perfect example of what you can do in your marketing. Split testing. A/B testing. To pelicans it doesn’t matter at all. But to your customers, it just might.

SHARE THIS ARTICLE

Filed Under: Marketing and Business Development

Get your copy of "20 Questions to Help You Expand Your Business Without Frustration or Overwhelm©"

I understand I will also receive email updates from Sue Painter or from the Confident Marketer. We never rent, sell, or share your contact information. See Privacy Policy​​ here.​

Related Posts

  • 3 Ways To Get Your E-zine Opened and Read
  • How To Organize Your Marketing and Get Results
  • How to Find New Clients Easily

Comments

  1. Kiyla Fenell says

    May 16, 2012 at 12:01 pm

    Ha! Great story Sue about split testing. Love how you used a great example of a smart way to market. Thanks!

    Kiyla Fenell

    Reply
  2. Jennifer Bourn says

    May 15, 2012 at 3:02 pm

    Sue – YES!!! When you change just one element at a time you can figure out EXACTLY what works the best so you can replicate it … I was starting to cringe when you were mentioning changing lots of things and “who cares what was different” … yikes! That’s sort of like throwing spaghetti at the wall and seeing what sticks … only you don’t know what was in the spaghetti to make it stick!

    Reply
    • Sue Painter says

      May 15, 2012 at 5:31 pm

      Hey Jennifer,
      I’m laughing out loud that you were cringing – I do, too, but that IS one of the “new things” being talked around. Nevertheless, as you say, it is NOT true split testing, for sure!
      Sue

      Reply
  3. Tiffany deSilva says

    May 13, 2012 at 1:06 pm

    You’re such a great storyteller, Sue! What a clever way to explain split testing. Now, hopefully more business owners will actually try a/b testing. 🙂

    Reply
    • Sue Painter says

      May 13, 2012 at 1:10 pm

      Thanks, Tiffany. 🙂

      Reply
  4. Bill Painter says

    May 12, 2012 at 2:14 pm

    Sue also decided to split test her crab claws to see if they were better cold or hot. (She likes hot.) Seriously if you split test and add a lot a of variables and some cost more than others, wouldn’t you want to know if the cheap one worked as well or better than a costly variable?

    Reply
    • Sue Painter says

      May 12, 2012 at 2:50 pm

      Bill!
      You tell too many stories on me, LOL!
      Sue

      Reply
  5. Mary Ellen Miller says

    May 11, 2012 at 8:57 am

    Love the story Sue and you really get the point across of A/B testing!

    Reply
  6. Trudy Scott, Food Mood Expert and Nutritionist says

    May 10, 2012 at 10:51 pm

    Sue
    Love the story of the pelicans! and great explanation of split testing…I go for changing one thing
    Trudy

    Reply
  7. Kathy McHenry says

    May 9, 2012 at 8:17 am

    This is a wonderful story and explanation on split testing. Thank you Sue

    Reply
  8. Brandi Kae says

    May 8, 2012 at 8:15 am

    Great story, Sue. Thanks for sharing.

    Reply
  9. Gail Saseen says

    May 8, 2012 at 6:51 am

    Great reminder.. Split testing is so important. It will help you keep your mind on the pulse of your list! Thanks Sue

    Reply
  10. Lisa Birnesser says

    May 7, 2012 at 2:36 pm

    Great analogy, Sue. I personally prefer the pure a/b split. It really gives a clear answer in what my readers want. Thanks- and hope you enjoyed your time in Florida!

    Reply
  11. Paula says

    May 7, 2012 at 10:01 am

    Oh, just love the visuals of this! What a riot! Can’t imagine not wanting to know which element works the best so you can replicate it. So necessary on an entrepreneur’s budget.

    Thanks, Sue.

    Reply
    • Sue Painter says

      May 7, 2012 at 10:55 am

      Thanks, Paula. The ever-inquiring mind!

      Reply

Join the Conversation Cancel reply

Sue Painter

Search

JOIN ME ON FACEBOOK

Sue Painter, business consulting and coaching

Contact Sue

Voice: 865-414-3393
Skype: knoxvillesue
E-mail: Sue@ConfidentMarketer.com
Contact Form

Knowledge Center

Search

Meet Sue

Passionate about helping small business owners create income with confidence, clarity, and big vision. Certified Book Yourself Solid Coach, and expert author for ezinearticles.com and SelfGrowth.com.

EPC Insitute LogoBook Yourself Solid Coach Amazon Best Selling Author Certified Agile Marketing Specialist Badge Ezine Articles Expert Author Blogspot - Top 100 Business Coach Blog Award Find Sue Painter on Amazon Social Media Marketing Society Member

Affiliates • Refund Policy • Disclaimers and Legal Rights
Affiliate/Earnings Disclaimer • Terms of Use • Privacy Policy

© Copyright 2010 - 2021 Confident Marketer

Consulting and Online Training for Women Entrepreneurs
All Rights Reserved