Tag Archive | "split testing"

1 Simple Tool To Build A Bigger List

If you could improve your opt-in conversions, grow your audience, and enhance your metrics with one simple tool, would you do it? I’m always interested in these things.  So it only made sense for me to try out tools that help me do this easier and faster. And that’s exactly what the Unbounce platform has to offer. I had the opportunity to give it a shot. Here are my thoughts.

Unbounce Basics

Unbounce is a do-it-yourself landing page platform. It’s powerful, it’s easy to use, and it’s designed with an emphasis on conversion optimization and list building.

  • It lets you build a page quickly. Templates are available but you can also make a page from scratch. This flexibility is a great feature because you can set a page up in minutes if you want to or you can spend more time setting something more in-depth up.
  • Metrics and analytics. This platform is built to provide you with powerful information. We’re all used to testing and tracking, but this system is dead simple to implement.  On top of that you get your stats in real time.
  • Testing tools for optimization. The platform has built in A|B testing, variant analysis, and conversion rate optimization tools. You don’t have to worry about setting them up on individual pages.  No cpanel nonsense.  No php scripts to configure.  It’s all there for every page you make – all the time.

Benefits Of The Platform

Unbounce brings a lot to the table.

  • The ease of setting up landing pages means that you’ll have no problem making as many as needed to hyper-target your audience. This kind of targeting leads to improved conversions.
  • In addition, it removes the need to worry about IT involvement. You have a state of the art WYSIWYG (what you see is what you get) editor that lets you do all the edits yourself.
  • You don’t need any knowledge of websites or coding in order to build out these pages. You’ll be doing it all visually, easy enough for anyone regardless of your technical background (or lack thereof).
  • With the easy testing and hyper-targeted landing pages, your CPA will naturally start to fall, meaning you get more revenue at the same spend.
  • The platform has integrated real-time data. It tracks and reports moment by moment so you’re able to adjust your strategy as dynamically as you like.
  • The Unbounce platform is inherently friendly to 3rd party software. It has its own powerful suite of tools but it’s actively integrating others for easy use. Google Analytics, MailChimp, and Flowtown are already integrated.
  • The easy design tools in Unbounce make it possible to expedite your process even if you’ve got a large and fast in-house development team.
  • You reduce the burden on your IT, letting them shift their focus off of the simple edits (“can you fix this little typo? Let’s change that one word…”) and onto what really matters for your mission-critical items.
  • No technical knowledge is required to start using Unbounce. It doesn’t have to be installed on a server. All it takes is signing up.
  • All of these features work together to help you market smarter and get things set up faster than you have ever before. Unbounce empowers you to build feature-rich landing pages, track their performance, and constantly learn and improve.

Unbounce Case Study

The Goal

Increase the site’s revenue by driving more traffic from the email list.  The list of 150K double opt-ins in the health market was under utilized.  We felt this plan gave us a chance to build a better relationship with people on our list and increase revenue.

We wanted to create segmented email lists that knew they were going to receive daily messages.  Our list of 150K double opt-ins were accustomed to getting 1 message per week on average.These messages would be super targeted teaser snippets of the day’s blog post, driving them back to the blog.  We designed it this way so we could monetize on-site using affiliate programs and Adsense.

The Process

Step #1 We used Unbounce to create 2 separate landing pages for each segment.  1 for healthy living and 1 for healthy eating.  Unbounce’s templates made this super easy to do.  I customized a template with my own images and copy.

Step #2 Created A/B split tests for each landing page

Step #3 Sent three emails to the main list promoting the new list segments for healthy living and healthy eating.

The Results

Strong conversions. Here’s how Unbounce reported the data.

Healthy Eating Landing Page Results

unbounce landing page statsclick to enlarge

 

Healthy Living Landing Page Results

unbounce split testing case study

click to enlarge

This was a simple test, designed to compare headlines.  I could have tested wildly different style landing pages, or colors, or copy, or images, or whatever I wanted.  The point is that setting this while thing up took me maybe 45 mins total.  That’s including the time it took me to create my account, learn the interface, find templates, write copy, insert pictures, create the split tests, and publish for use.

The verdict? I think this is a powerful and very beneficial tool for anyone who uses landing pages, not just affiliate marketers.  If the technicalities of split testing or creating landing pages has ever held you back before – this is the tool for you.

What do you think? Have you used the platform? Tell me in the comments.

Posted in Case StudiesComments (1)

Get the Best Results from Your Creative Testing

How many times has your designer kicked out a ‘final’ creative asset based on best practices, gut feelings, “experience”, or if you’re lucky, historical data? Ever get the sense they nailed it on the first try? I haven’t and it can be so frustrating to ask for multiple versions or styles. Well, when resources are constrained, the best thing to do is utilize your knowledge of A/B and Multivariate testing.

 Testing Methods

There are several methods to employ when testing components of your creative assets, but the two most common are; A/B and Multivariate testing. For the sake of simplicity we will focus on these two and leave the more complex testing methods to the professionals.

 A/B Testing

A/B testing is defined as the method of testing a baseline Control [original creative asset] compared to a single-variable Sample [your revised asset] to improve response rates. Making sure you only have one variable being tested during the process is critical to success. Skewing outcomes can be very easy when introducing multiple iterations if you’re not controlling for them.

A simple example, if you’re A/B testing a subject line in an email (Control and Sample) to see which has the higher open rate, keep it as simple as possible. Send out the emails at the same time, don’t change email headlines or CTA buttons and only test for subject line. If you introduce other variables, you will skew your results. Alternatively, if you’re testing the color of a call-to-action button, you will want to keep everything static on the page, only test one variable at a time; your call-to-action button.

I like having several versions of an asset queued up to test. Use the existing asset in place as your Control and have several different Samples in the queue ready to rotate and test. Test your Control to Sample 1, if the Control wins, test the Control against Sample 2. If Sample 2 wins, test Sample 2 against Sample 3, etc. I call this simple A/B progression testing.

Controlling for variables outside of your website or design is important. For example, control for; large social events (the 2008 Olympics skewed tests I ran during that time), time of day, day of week/month, and most importantly, any seasonality your business experiences throughout the year.

 Multivariate Testing

When looking to test more than one variable at once, you’ll want to engagement the methods of multivariate testing. Defined as the process by which more than one component of a website (or creative asset) may be tested in a live environment. For example, perhaps you have five different hero images and five different headlines you’re interested in seeing which combination yields the highest click-through rate. Ensure you have the right technology to randomize the 5 different hero images and headlines evenly across time to ensure a large enough sample size interacted with your test before drawing conclusions.

Another form of testing multiple variables is what I like to call multilevel-multivariate testing. An email example of this includes; testing different subject lines, the color of your email’s call-to-action button, and the copy of your Sign Up page’s “submit” button. This form of testing involves three assets and flows through three different interaction levels; 1) opening the email (subject line), 2) clicking-through from email to website (call-to-action button) and 3) conversions on your website’s landing page (submit button).

 Testing Sample Size

I can’t tell you how many times I’ve rolled out a simple test and got so excited when I saw my Sample was winning. I would run around and tell everyone the new design was winning and yell and scream we should roll it out 100%. Well, thankfully there were others there to tell me to shut up, calm down and check my sample count. You can’t make rash decisions based on premature data and sometimes need an impartial party to keep you in check.

There are a few components you need to understand prior to testing; sample size, confidence level, confidence interval and population.

Sample Size:

  • These are the users exposed to your test, the more users within your sample, the greater the likelihood your results will represent your entire population.

Confidence Level:

  • This is a percentage telling how accurate your test is. It symbolizes how likely your entire population will behave as your sample population behaved. Most tests are done until they achieve a 95% Confidence Level, meaning you’re 95% certain that your sample population reflects the same behavior as would your entire population.

Confidence Interval:

  • This is an interval representing the percentage difference from your sample results.  If your confidence interval is ‘+/-5’ and 60% of your sample population responded positively to your test, then 55% to 65% of your entire population will respond the same.

 Population:

  • This is the number of total users in your entire population. For example, if your email list is 1MM people, then your ‘entire population’ would be 1MM users, your sample size may only need to be 5,000 to hit the confidence interval you’re looking for. You’ll derive the needed sample size from your population size and desired confidence interval.

Now that you understand the fundamentals of your needed sample size, prior to launching your test you should have an agreed upon confidence interval. Typically, a 95% confidence interval is an acceptable margin of error. Depending on the value of your test, you may be inclined to accept a lower confidence interval or if you’re testing a multi-million dollar outcome, you may want to see a 99% confidence interval.

Lastly, to ensure your sample users best represent your entire population, make sure they are randomized. Again, this oversight will skew results and not reflect the opinions or behaviors of your entire population. Here is a free confidence interval calculator to determine the sample size for a corresponding confidence interval and population size.

You’re now set, ready and excited to kick off your next creative asset test. For additional information on testing creative assets, refer to Testing Creative Assets for Stellar Performance. For all of your affiliate marketing needs, there is HasOffers; the leader in Affiliate Tracking Software. Please feel free to contact me or leave comments below

Posted in Affiliate Marketing, CPA MarketingComments (1)

Testing Creative Assets for Stellar Performance

Remember the time your design team created that new landing page, call-to-action button, or email? You remember the one, the one that was going to be the end-all-be-all as the single greatest success in your creative career. Well, how’d it go? Was it as amazing as you thought it would be? If it’s like anything I’ve put out, it had a few more versions to go. The key to successful creative assets is to always be testing. If you’re running an affiliate program, the right affiliate tracking software will assist in testing, tracking and optimizations.

Before we jump into commonly tested components, I want to bring up establishing a hypothesis prior to launch. I’ve encountered many instances where people roll out tests and didn’t know what they were looking to observe. Make sure that you have an accurate hypothesis based on what variables or KPIs you’re testing and determine what each outcome will mean and represent. If you’re real good, you’ll have a post-test action plan.

Let’s move on to the many different components we can test. Please keep in mind; these are not all of them, just commonly tested ones that can produce medium to large improvements.

Copy

Whether it’s a title, headline, subject line or some other form of first-see-copy, make sure to provide; timely, targeted, relevant and appropriate copy. Use the 2 second rule; your headline has 2 seconds to grab attention and confirm users have found what they’re searching for. Alternatively, this can help deter users who aren’t looking for what you’re offering, saving you money if you’re paying per click.

Make sure to test different copy and appeal to your user’s emotions. You know the reasons your customers need your products or services, appeal to that emotion and reaffirm your solution. This reminds me, write copy that is customer-focused and not company-focused. This will indirectly increase your sales as you’re solving a problem rather than advertising a product.

Constantly test different variations of copy that appeals to your users, focus on; tone, style and theme. Look into the different demographics of your audience and see what resonates best with them.

Call-to-Action

The call-to-action encourages your user to do something, which makes it one of the most important assets to test and optimize. I recommend testing five to ten different variations of your call-to-action and test which renders the highest click-through rate. Remember to display and rotate your assets evenly. If you’re not randomizing, your results will be skewed.

Common call-to-action text include; “Start”, “Submit”, “Go Now” or even the age old “Click Here”. Internet users have become numb to these phrases over the years. Still test them, but also test longer messaging that provides more targeted information. For example, a retailer might want to A/B test the following text; “Buy Now” vs. “Proceed to Checkout”. More information in your call-to-action button will do two things; increase your click-through rate and better qualify users.

Test the following when optimizing your call-to-action buttons; copy, length, color and size. Test messaging that is short and sweet versus informative and lengthy. Try as many different colors as possible, when you find a winner, test different shades and gradients. Test the size of the call-to-action, studies have shown size relative to its surroundings can make incremental improvements to click-through rates. Which leads to my last point, test the various locations on your site where your call-to-action is placed.

 

Landing Page / Sign-Up Page

The length of your form will largely dictate the success of your conversion rate. A short form (typically 4 to 8 fields) can yield much higher conversion rates than long forms (8+ fields). I would start by, what information is critical to capture? A lot of companies use required fields and optional fields. This is a great idea, make sure to A/B test required + optional vs. just required. You may decrease your conversion rate by displaying too many fields (required + optional) to your users and overwhelm them.

Adding credibility logos to your site can increase user confidence and provide a sense of security. I’ve seen mixed results with credibility logos, so plan to test several of these. In addition to increasing user confidence through credibility logos, experiment with testimonials at the bottom on your conversion page. Users feel more confident knowing others have had success when interacting with your site. Use your Thank You emails to incentivize users to post testimonials on your site.

I’d also recommend displaying inbound phone numbers on your purchase or conversion pages. These appeal to users who don’t feel comfortable transmitting personal information over the internet. Additionally, less technologically savvy users convert or purchase over the phone more than online. Utilize a third party call tracking systems to correlate your conversions to specific media channels or affiliates. RingRevenue is incorporated in your HasOffers affiliate software to track inbound calls.

Results

No one is perfect and therefore no asset will be either. Be patient and think creatively, you’re going to find greater successes when you think outside the box. At first, you’ll see big wins and you’re going to need to harness that energy when it comes to squeezing the lemon for those 10 basis point increases in the future. Don’t spend too much time on the little victories, start thinking about your next big success and move quickly.

 

 

Posted in Affiliate MarketingComments (0)

How I Make an Extra $75K/year Off One Little Campaign and Why Split Testing Is a Complete Waste of Your Time If……

Are you currently utilizing split tests in your marketing efforts?


Your answer better be yes, and if not, you should probably stop reading this article immediately and start implementing split tests right now.

If you ARE currently split testing, are you using a statistical significance calculator to interpret your results before taking action?

Again, your answer better be yes, or you very well could be wasting your time with split testing and losing out on a lot of profit.

Split testing and not correctly interpreting and taking action on those results is without a doubt the number one biggest mistake I see affiliates making.  Either the affiliate isn’t split testing at all, or the affiliate is making unfounded assumptions about the results.

I’ve been in the industry since 1999, as an advertiser, affiliate, and have owned multiple CPA networks.  I can literally count on two hands the number of affiliates I know that correctly utilize split testing and calculate the results properly.  This is such a HUGE problem and almost nobody pays attention to it.

For those of you that aren’t familiar with statistical significance, to strip it down to a brief summary:  A statistically significant result is one that is unlikely to have occurred by chance.

So why should you care about this as an affiliate?

Statistical significance sounds like some nerd-driven term that you should completely ignore.  Big mistake.

Probably the best way to illustrate how important it is for you to understand this concept is to look at some split test results.

Here are some actual results from a targeted grant campaign I was running.  This is the first group of 100 visitors:

Offer 1 – 100 visitors, 3 conversions  =  3% conversion rate
Offer 2 – 100 visitors, 8 conversions  =  8% conversion rate

After 100 visitors each, offer 2 has more than double the number of conversions and conversion rate of offer 1.

Which offer would you run?  Well with more than double the conversions after 100 visitors it’s pretty clear offer 2 is the hands down winner right?  …Wrong!

I’ll spare you from the math formulas, as there are a number of solid statistical significance calculators out there that will do the math for you.  However, with this particular test, here are some interesting mathematical results…

For offer 1, we can be 95% confident the actual conversion rate long-term will fall between .19% and 5.81%.
For offer 2, we can be 95% confident the actual conversion rate long-term will fall between 3.52% and 12.48%.

Those are some HUGE differences.  So assuming that offer 2 is the winner from this split test could cost you a LOT of money long term.  In fact, here are the results after 5000 visitors:

Offer 1 – 5000 visitors, 290 conversions, 5.8% conversion rate
Offer 2 – 5000 visitors, 237 conversions, 4.7% conversion rate

Offer 1 was the true winner and converted 1% better.  If I would have just eye-balled the split test results like most affiliates do, I would have chosen the wrong offer long term, and for just this one campaign the difference in profits would have been over $75,000 in the first year alone.

I don’t know about you, but I hate missing out on $75K extra per year just because I didn’t use a statistical significance calculator to make sure my split test decisions were correct.

As an advertiser I can’t count how many times I’ve dealt with an affiliate promoting one of my offers that calls me or sends me an email mid-day that says something like, “I am pausing the offer, and I want to know why my conversion rate for the day so far is half of what it normally is.”  This of course is after like 500 visitors and he of course has not done any statistical significance calculation at all.

I normally do my best to explain to them the offer hasn’t been touched so it’s something on their side, the ad network side, the cpa network, or much more likely…it’s simple statistical deviation.

As you can probably imagine, that usually flies like a ton of bricks.

Quite honestly it’s hard to blame them because the numbers can look so very blatant and obvious in one direction when in fact it might be the opposite.

I shouldn’t really need to drive this point home any longer…lets get straight to the tool you need to start making better decisions about your data.

Click Here to Download the Calculator Spreadsheet

The guys over at visual website optimizer also have a handy little web-based calculator which can be found here:

http://visualwebsiteoptimizer.com/ab-split-significance-calculator/

The web-based tool doesn’t quite give you as much information and detail as the downloadable calculator, but it’s great for a quick check.

If you’d like more information on how to use the calculator in detail, be sure to checkout the video on this page where I do a complete walk through for you, as well as provide some extra insight into statistical significance and how you can leverage it to make more money.

Posted in Affiliate MarketingComments (3)


Subscribe via RSS

Switch to our mobile site