But, what is not a fact is that there is a \u201cbest way to prioritize a\/b tests<\/a>.\u201d<\/p>\n\n\n\n Whether it\u2019s PIE or ICE A\/B testing framework, there are plenty of experts out there who will argue that their prioritization model is best. And while the Google results might tell you otherwise, there is no single best prioritization model.<\/p>\n\n\n\n Here is the long and the short of it. The best prioritization framework is not necessarily simple, binary, or numerical. The best prioritization model is the one that works for your team. That\u2019s it. If it sticks, it fits.<\/p>\n\n\n\n After reading one too many “The Best Way to Prioritize Your A\/B Tests” articles, we sat down with our one of our in-house user experience and digital journey optimization experts, Natalie Thomas, to get her thoughts on the topic.<\/p>\n\n\n\n Keep reading to learn how to find the right prioritization model for you, what to think about when prioritizing, what prioritization model our team uses, and why the framework works well for us.<\/p>\n\n\n\n <\/p>\n\n\n\n The right prioritization model is going to depend on the factors of your organization:<\/p>\n\n\n\n The list goes on! As we say, there is no single approach is the best for everyone.<\/p>\n\n\n\n When we started doing optimization<\/a>, we were early practitioners. There weren\u2019t flourishing experimentation communities or a plethora of think-pieces about how to do it \u201cright.\u201d<\/p>\n\n\n\n We had to hire smart people and trust that they would figure it out.<\/p>\n\n\n\n Most jobs rely on both smarts and experience to succeed. As an industry, we were very short on applicants with experience. So, our prioritization process developed out of trial and error from the smart people here at the beginning of optimization as a field.<\/p>\n\n\n\n Now we can truly say we have a \u201cprocess\u201d that gets us great results. It\u2019s called the ADVIS\u2019R Prioritization Framework\u2122\ufe0f and it works well for teams like ours: outsourced optimization teams who need a lot of transparency, quick results, and a focus on outcomes.<\/p>\n\n\n\n For the most part, we work with teams who are already running experiments, want to develop a more systematic approach to experimentation, and have oversight from a decision-maker who wants transparency into the process.<\/p>\n\n\n\n So, we needed something that worked well in that context. We developed the ADVIS\u2019R Prioritization Framework\u2122\ufe0f accordingly.<\/p>\n\n\n\n The ADVIS\u2019R Prioritization Framework\u2122 is an acronym for the following:<\/p>\n\n\n\n Some metrics are binary and some use the stoplight system (red-yellow-green).<\/p>\n\n\n\n Alright, starting from the top.<\/p>\n\n\n\n Appropriate is a binary metric used to determine if a concept is suited for testing over implementation or consideration.<\/p>\n\n\n\n All of the following filters have to be a \u201cyes\u201d for a concept to go to the next step:<\/p>\n\n\n\n In this step, we ask, \u201care we capable of running this experiment?\u201d<\/strong> <\/p>\n\n\n\n Sometimes a test is simply not feasible. Maybe it\u2019s not feasible due to platform constraints, or the load time would be too impacted. If the answer is a no, then full stop.<\/p>\n\n\n\n It\u2019s time to pivot to a measurement method other than A\/B testing. It might be more suited for rapid testing<\/a>, so you can still get validation, but it\u2019s not going to be tested on the live site.<\/p>\n\n\n\n Once you determine that an initiative is appropriate for experimentation and doable, then you can move on to assessing the value, importance, and speed.<\/p>\n\n\n\n
<\/div>\n\n\n\nI understand there is no \u201cone size fits all\u201d for A\/B testing framework and prioritization, but how can teams assess if a method is right for them?<\/h2>\n\n\n\n
\n
Let\u2019s take The Good as a case study. How did you decide on a prioritization method that worked best for your clients?<\/h2>\n\n\n\n
How did you land on this framework?<\/h2>\n\n\n\n
What exactly is the ADVIS\u2019R Prioritization Framework\u2122\ufe0f?<\/h2>\n\n\n\n
\n
![\"ADVIS'R](\"https:\/\/thegood.com\/wp-content\/uploads\/ADVISR-Model-1-1024x576.jpg\")
<\/figure>\n\n\n\nWalk me through it.<\/h2>\n\n\n\n
Appropriate<\/h3>\n\n\n\n
\n
Doable<\/h3>\n\n\n\n