Whether you were the type of student who worshipped the scientific method and couldn\u2019t wait for chemistry class, or the type who still isn\u2019t sure about the difference between a hypothesis and a hypotenuse, learning how to build a kick-butt A\/B test hypothesis can open the door to increased profits and a steadily climbing return on investment for your ecommerce website.<\/p>\n\n\n\n
You may already understand the basics of conversion rate optimization (CRO) testing, or you may just be getting started. You may already be familiar with how the A\/B test hypothesis is formed, or this may be the first time you\u2019ve heard of it. Either way, this article will help you leverage the power of CRO to get more conversions.<\/p>\n\n\n\n
By the time we\u2019re finished here, you\u2019ll know all about the A\/B test hypothesis: what it is, how to create it, and how to use it.<\/p>\n\n\n\n
What is an A\/B test hypothesis?<\/h2>\n\n\n\n
In ancient Greece, science and philosophy were considered partners. The aim of science was to increase wisdom, and the \u201chypothesis\u201d (literally \u201cplaced under\u201d) was the basis of a well-constructed argument. Socrates, Plato, and Aristotle knew that a sound hypothesis could lead one to a sound conclusion.<\/p>\n\n\n\n
That unyielding search for truth led to the development of what we now know as the \u201cscientific method,\u201d which is the basis of the A\/B testing we do today.<\/p>\n\n\n\n
Here are the components of that process:<\/p>\n\n\n\n
- Observe the situation, define a problem, and ask a question<\/li>
- Formulate a hypothesis (a proposed solution or explanation)<\/li>
- Test the hypothesis with experiments<\/li>
- Collect and analyze the results<\/li>
- Interpret the results and keep testing until you\u2019re satisfied with the solution<\/li><\/ul>\n\n\n\n
Without the hypothesis, there can be no test \u2013 since proving or disproving the hypothesis is exactly what the test is about!<\/p>\n\n\n\n
TIP:<\/strong> While it\u2019s true there is no \u201cbad hypothesis,\u201d (since you always learn something from each test), a tightly constructed A\/B test hypothesis will get you closer to the solution quicker. Spend a little more time on developing the hypothesis, and you\u2019ll need to spend less money on testing.<\/p>\n\n\n\n
EXAMPLE:<\/strong> TreeRing<\/a> helps schools and students create less expensive, creative yearbooks. They came to The Good for help getting more leads. We used the scientific process (listed above) to conduct A\/B testing aimed at conversion rate optimization.<\/p>\n\n\n\n
One part of the process went like this:<\/p>\n\n\n\n
- Our team conducted a<\/strong> conversion audit of the TreeRing website, which highlighted areas of concern based on data like the clicks and movements of their site visitors. We wanted to know how leads were generated and why lead generation conversion wasn\u2019t hitting TreeRing\u2019s goals.<\/li>
- We formulated a hypothesis about the dropdown menu in the header<\/strong>. We theorized that moving the link to request a free sample to the top of the menu list would draw more clicks and boost the conversion<\/a> rate.<\/li>
- We tested the hypothesis by using the current menu as the \u201ccontrol\u201d<\/strong> and the new arrangement as the variation for the A\/B test.<\/li>
- We collected the results and crunched the data.<\/strong> The test configuration sent 42 percent more visitors to the free sample landing page and drew 12 percent more requests for the sample.<\/li>
- Since testing proved our first assumption true,<\/strong> we then proceeded to develop and test another A\/B test hypothesis to see if we could push the conversion rate even higher.<\/li><\/ul>\n\n\n\n
See the TreeRing case study for more insight.<\/p>\n\n\n\n
![\"ab](\"https:\/\/thegood.com\/wp-content\/uploads\/ab-test-hypothesis.png\")
The graphic above is from an actual A\/B testing experiment. See the TreeRing case study (described below) for more information.<\/figcaption><\/figure><\/div>\n\n\nA good hypothesis explains why the change of an element will influence the customer behavior. <\/a><\/span>Share on X<\/a><\/span>\n\n\n\n Notes on the creation of an A\/B testing hypothesis<\/h2>\n\n\n\n
Your ability to identify potential trouble spots and develop high-probability theories about how to repair them will grow over time. At The Good, our team members are skilled CRO researchers with years of entrenched experience. The more you work with conversion rate optimization and A\/B testing in particular, the quicker and easier the process becomes.<\/p>\n\n\n\n
To learn how to build an A\/B test<\/a> hypothesis, you need to get in there and practice. There is no substitute for hands-on experience. If you\u2019re not sure how to get started, no problem. Contact The Good<\/a>. We\u2019ll help you launch a robust CRO testing program.<\/p>\n\n\n\n
TIP:<\/strong> Finding something to test isn\u2019t difficult. You can test every part of your ecommerce website \u2013 every word of copy, every layout, every configuration. The tough part is deciding which parts you should<\/em> test. You\u2019ll want to identify the areas that present the most potential for increasing conversions.<\/p>\n\n\n\n
Begin with research<\/h3>\n\n\n\n
Closely observe the path your visitors take on their way to becoming customers and repeat customers. The journey to sales includes many micro conversions that lead to the macro conversion, the desired result \u2013 typically placing an order.<\/p>\n\n\n\n
Your aim is to find areas where traffic is moving smoothly and areas where traffic is slowing down or dropping off. These are good tools to help you dig deep and uncover root problems. At The Good, we use a comprehensive conversion audit process. Our Stuck Score\u2122 self-evaluation can also provide an excellent starting point.<\/p>\n\n\n\n
You must ask yourself, \u201cWhat business or customer experience problems do we think we can solve for this element of the site, and why do we think those changes will impact a certain KPI?\u201d<\/p>\n\n\n\n
The success of your optimization program is directly related to your ability to identify an A\/B test hypothesis that will move the needle for your business.<\/p>\n\n\n\n
Here\u2019s a short list of tactics you can employ to take your research deeper:<\/p>\n\n\n\n
- Look for case studies and blog articles related to the problems your initial assessment<\/a> identified<\/li>
- Collect and study customer feedback<\/li>
- Collect and study feedback from customer service, your sales team, and your support team<\/li>
- Use customer surveys to solicit specific feedback<\/li>
- Pour over analytics data<\/li>
- Employ tools like heatmapping to observe visitor behavior<\/li>
- Employ user testing to observe the entire visitor experience<\/li><\/ul>\n\n\n\n
With experience, you\u2019ll get a feel for how many of these you need to employ. For cost-effective CRO testing, you\u2019ll want to make sure your investment is balanced favorably against the potential returns.<\/p>\n\n\n\n
Create a list of possibilities and select your hypothesis<\/h3>\n\n\n\n
Your research will illuminate one or more stuck points \u2013 barriers to sales. Choose one of them to investigate further. What could you do to free up the flow of traffic at that point on the sales journey? Where would the metrics you\u2019re observing need to be before you consider the effort successful? How can you achieve those metrics?<\/p>\n\n\n\n
Before you settle on a hypothesis, brainstorm for possibilities. There are times when your first hunch is correct, and there are times when the lightbulb comes on after a dozen potential solutions are proposed.<\/p>\n\n\n\n
Don\u2019t evaluate the proposals until you\u2019re out of ideas. Take a break, come back to the table and try one more time: What could we change that would move the results we\u2019re seeing towards increased conversions? How could we make that change? What exactly would the change look like? What do we think would happen as a result of the change?<\/p>\n\n\n\n
Rank your ideas and choose the theory most likely to create the desired effect. At The Good we use an RDI ranking scale: Risk, Difficulty, and Impact. Each is assigned a one to ten rating. Before investing time and money in a test, we want the average of those scores to be six or better. The winner is your hypothesis.<\/p>\n\n\n\n
NOTE:<\/strong> Your hypothesis isn\u2019t a question. It\u2019s a clear and measurable statement that answers your questions. For example, our hypothesis in the TreeRing example given above could be stated like this: \u201cMoving the free sample link from the bottom of the menu to the top of the menu should increase the final conversion rate by at least 10 percent.\u201d<\/p>\n\n\nUnanswered questions kill conversions. So the first job of the CRO is to learn the top questions and answer them on the page. <\/a><\/span>Share on X<\/a><\/span>\n\n\n\n
Should you conduct A\/B or multivariate tests?<\/h2>\n\n\n\n
The simplest, most direct testing method is to focus on changing just one thing at a time. A\/B testing does just what it says. It compares version A against version B. In our TreeRing example, we tested leaving the free sample link at the bottom of the menu versus moving it to the top of the menu.<\/p>\n\n\n\n
NOTE:<\/strong> In A\/B testing, it\u2019s critical that you change only one thing at a time. Otherwise, you won\u2019t be able to clearly determine the cause of the results.<\/p>\n\n\n\n
Multivariate testing allows you to test more than one change at a time. You test combinations of variables simultaneously. The benefit to multivariate testing is that you can get to a total solution quicker than with A\/B testing. Drawbacks are that it\u2019s more complicated, more expensive, and will require more traffic to get dependable results<\/a>.<\/p>\n\n\n\n
Create your A\/B test hypothesis and start testing!<\/h2>\n\n\n\n
You know what an A\/B test hypothesis is, and you know how to create it. You know why testing is critical to conversion rate optimization, and you have access to the data you need to get started.<\/p>\n\n\n\n
Use the steps and tips covered here to find a problem, develop a hypothesis, test the hypothesis, and evaluate the results. Use the information gleaned from that process to keep optimizing your conversions at every point on the sale journey.<\/p>\n\n\n\n
If you need help (or even if you just want access to the tool), get your free customized Stuck Score\u2122 from The Good. It benchmarks key conversion areas of your ecommerce website to find growth<\/a> opportunities that may now be hidden.<\/p>\n\n\n\n
Many of your competitors think creating an A\/B test hypothesis is too complicated. They won\u2019t take the next steps. But now you\u2019re armed with the tools to move forward. That gives you a huge advantage. Move on it!<\/p>\n\n\n\n
Resources:<\/p>\n\n\n\n
- We formulated a hypothesis about the dropdown menu in the header<\/strong>. We theorized that moving the link to request a free sample to the top of the menu list would draw more clicks and boost the conversion<\/a> rate.<\/li>
- Our team conducted a<\/strong> conversion audit of the TreeRing website, which highlighted areas of concern based on data like the clicks and movements of their site visitors. We wanted to know how leads were generated and why lead generation conversion wasn\u2019t hitting TreeRing\u2019s goals.<\/li>