
Table 2: Prioritization Matrix, Source: “ Project Prioritization: A Structured Approach to Working on What Matters Most” (PDF), Office of Quality Improvement at University of Wisconsin, Madison. The guide provides generic criteria (see below), which you can supplement with marketing and product-specific criteria, such as New Release, Response to Competition, Senior Executive Mandate, and so on. Determine your criteria and rating scale.The guide outlines five steps for creating a prioritization matrix based on importance: This approach appeals to analytical leaders who value a data-driven approach to decision making. The benefit of the matrix is that it provides a consistent method for evaluating options and takes some of the emotion out of the process by quantifying the decision with numeric rankings. This matrix helps prioritize complex or unclear issues when there are multiple criteria for determining importance. Finally, choose your activities wisely.Īnother matrix that helps you make tough decisions objectively is explained in the guide Project Prioritization: A Structured Approach to Working on What Matters Most (PDF) by the Office of Quality Improvement at University of Wisconsin, Madison.Plot the activities on the Action Priority Matrix.Score them on impact (from 0 for no impact to 10 for maximum impact) and then on effort involved (from 0 for no real effort to 10 for a very major effort).List the activities that you’d like to complete.To use the Action Priority Matrix, TimeAnalyzer suggests that you: Not only do they give low returns, they steal time better spent elsewhere. Hard Slogs (Low Impact, High Effort): Avoid these.Fill Ins (Low Impact, Low Effort): Do these if you’ve got spare time, but drop them if something better comes along.If you’re starting a Major Project, make sure you complete it quickly and efficiently and that you move on as soon as you can. Major Projects (High Impact, High Effort): While these give good returns, they take a long time to complete, meaning that one Major Project can crowd out many Quick Wins.Quick Wins (High Impact, Low Effort): These are the most attractive projects and give you a good return for relatively little effort.Table 1: Action Priority Matrix, Source: Plotting each activity on the Action Priority Matrix lets you see the projects that give the greatest return on your effort and helps you adopt the most effective approach for that activity:

According to TimeAnalyzer, the principle behind using this technique is that you score each activity you want to complete on two scales: first on the impact the activity will have (the y-axis) and second on the effort involved (the x-axis). The Action Priority MatrixĪ diagramming technique called the Action Priority Matrix adds another dimension to the basic strategy and maps it on a grid. “The test ratings will be essential for helping you and your senior executives prioritize the order of your upcoming tests,” says Page. In his book, “Web Optimization: An Hour a Day,” Page advises you to organize your list of A/B test ideas and rate them in terms of both the likely conversion lift value and the difficulty of implementation (also known as LoE: Level of Effort). Rich Page offers a similar suggestion and takes it a step further.

On his website, Occam’s Razor, Kaushik says that “To have a direct impact faster, lower the bounce rate and reduce acquisition cost.” He cautions against obsessing about every change, but instead suggests that you focus on increasing profitability. Basic Prioritization StrategiesĪvinash Kaushik, author of “Web Analytics 2.0,” notes that you should work on the money-makers first. Use these recognized strategies for getting your priorities straight. It’s great to have all these ideas, but how do you filter the demands and separate the high-priority A/B tests from those that can wait? Don’t let yourself become overwhelmed by this challenge. They’ve also heard the buzz that you and your optimization team have proven that you can run more A/B tests in less time.

Website stakeholders from all over your company are generating lots of A/B test ideas because they know that A/B testing live traffic yields powerful results. This is especially true if you work in optimization. Sometimes, having too much choice leaves you paralyzed.
