Bayesian Strategy
Hannibal Smith, the fearless leader of the A-team, always loved it when a plan came together and on that campy ’80’s TV show, they always seemed to, no matter how intricate and contrived. It seems quaint now. In the real world, things rarely happen as we imagine they will.
As Mike Tyson, another icon from the ’80’s, liked to say, everybody’s got a plan until they get hit and, like it or not, we all get hit, usually sooner rather than later. When that happens, as it inevitably always does, even our best laid plans go awry.
In truth, planning has never been about strategy, but control and control has always been an illusion. Nevertheless, for a long time, it was true enough to be successful. Plans set direction and, if problems arose, plans could always be changed. The problem is that as technology cycles compress, planning cycles can’t keep up. We need a new model.
The Rise and Fall of Strategic Planning
When Alfred Sloan conceived the modern corporation at General Motors, he based it on hierarchical military organizations. Companies were split into divisions, each with their own leadership.
Orders flowed downwards and your rank determined your responsibility. It was in this context that strategic planning and techniques like SWOT analysis took hold.
By the 1980’s, the seams started to show. When Jack Welch took the helm of General Electric he largely dismantled the strategic planning process, because, as he said at the time,”the books got thicker, the printing got more sophisticated, the covers got harder and the drawing got better,” but none of that improved how the company performed.
Today, planning has become even less tenable. As the pace continues to accelerate and technology cycles become shorter than corporate planning cycles, the false certainty that planning engenders is becoming an impediment to, rather than a tool for, attaining objectives.
As Roger Martin put it in a recent article in The Harvard Business Review, strategy is not planning. There is a better way.
Why Our Numbers Are Always Wrong
In the academic world of statistics, there has been a similar debate raging over how we should use information. Up until recently, the predominant approach has been frequentist statistics, the kind you most likely learned in school, which utilizes controlled variables and large sample sizes to arrive at conclusions that are statistically significant.
If a hypothesis passes the significance test then it is treated as being true, but a lot can go wrong. Sometimes controls are overlooked or data is mishandled or you simply get freak results (95% confidence is standard, which leaves ample room for error). Just because a study says something is true, doesn’t mean it is.
A recent study in the journal Nature found that a majority of cancer research studies could not be replicated. That’s scary. Incredibly scary. Do we really believe that the data we’re feeding into our strategic plans is any better?
How to Become Less Wrong Over Time
The alternative is the Bayesian method, in which you simply guess at the answer and then continue to collect data as it comes in. It doesn’t convey the same sense of certainty that the “hard numbers” of the frequentist method do and you can still get wrong answers, but they become less wrong over time and you get a sense of how likely they are to be right.
To give a simple example, if a frequentist was asked to evaluate a free throw shooter in basketball, he couldn’t give you an answer until he saw a fixed amount of trials (say 100). You would simply have to wait. If you wanted to check again later, you would have to do another 100 trials.
A Bayesian, however, would keep updating his evaluation from the very first attempt and would continue to keep a running score. In today’s business environment, we simply can’t wait for the strategic equivalent of 100 free throws.
Unfortunately, there just seems to be something about guessing that just doesn’t seem right to tough minded, hard data types, which is why Bayes and his method fell out of favor. Nevertheless, it’s been making a comeback lately.
The Road To The White House
The 2012 presidential election was unusual for two reasons. Firstly, despite a poor economy, the incumbent, Barack Obama, won by a surprisingly comfortable margin. Second, polling played an unusually prominent role in the coverage of the race. Bayesian methods played a part in both.
As Sasha Issenberg reported in The Victory Lab, Obama’s campaign collected a large amount of data to determine the probability that a particular individual would support the president and turn out for the election. As more data came in, these scores were adjusted. The results were then used to run simulations.
Nate Silver also used Bayesian methods to predict the outcome of the election. He aggregated public polls along with other data and ran all of it through a model to test outcomes under different conditions. He not only got the final outcome right, but correctly predicted the results of all 50 states and the District of Columbia.
In a sense, there wasn’t just one election, but millions of them: The one in the real world and the countess other run by computer models.
Management by Simulation
It’s become increasingly obvious that the old planning model has become untenable. It not only relies too heavily on weak evidence, but it’s simply too slow. We need discard our false sense of certainty and learn to rely more on simulation. Perhaps not surprisingly, “test and learn” is a phrase that has become standard in the corporate lexicon.
Much like financial analysts have used scenario planning to test multiple strategies, digital marketers constantly run small campaigns to carry out A/B testing so that performance increases over time and logistics operations run their routes through genetic algorithms before they start loading trucks.
Failing “fast and cheap” is becoming too slow and too expensive.
As our information technology continues to advance and the Web of Things gives us an unprecedented amount of data to work with, we’re beginning to use agent based models and Bayesian methods to predict likely outcomes of everything from disease epidemics to the consequences of economic and political policy.
One thing’s for sure, the days of plans are over. In the future, we’ll need to simulate failure in order to succeed real world.
– Greg
Greg – timely & provocative as always. A point of clarification. Are you suggesting scenario planning does or does not have a role to play in the new economy? I’m a stalwart fan of it but, from this post, surmise that you consider it too slow and not agile enough as a methodology?
Sorry if that wasn’t clear, Hilton. I have no problem with scenario planning, which originally arose as an alternative to strategic planning. However, it is primarily used for either financial planning or long term strategy, where the need to update is obvious.
What I mean to say is that we need to inject Bayesian mechanisms into all of our plans. A good example is media planning, which used to be a power-point/meeting driven process, but is now highly automated and adaptive. Creative executions are going that way as well and “creative optimization” is becoming a fairly standard practice.
As the informational content of our products and services continues to rise, everything needs to adapt on the fly. Today, we think nothing of getting a few dozen updates to our phone every week, soon our cars, homes, medicine and just about everything else you can think of will work the same way.
What will we plan for?
– Greg
Hi Greg, interesting as usual. forwarded to my students as complement to article written on pharmaphorum on strategy and evaluations where key drivers involve sales estimates (http://www.pharmaphorum.com/2012/07/26/strategy-evaluations-part-two-developing-sales-estimates/). Best
Cool! Thx!
– Greg
Greg,
Good post. It seems to me that Bayesian methods to predict uncertainty is not the correct task at the moment.
Predictability can only be found in a (Gaussian) world where averages are meaningful.
Gaussian distributions tend to prevail when events are completely independent of each other. As soon as you introduce the assumption of interdependence across events, Paretian distributions tend to surface because positive feedback loops tend to amplify small initial events.
Industrial economy has been “product”-oriented and based on calculations of the amount of the products. Today this “hard model” of economy is limited by “Race against the Machine”.
Modern economy is “agent”-oriented and based on relationships and interaction of these autonomous agents. Market infrastructure (industrial, informational, etc.) remains in the strategic planning framework. But volatile part of the market is developing within the various attractors – self-developing ecosystems (as Apple made). Old economy concepts and assumptions as a “demand and supply”, market “balance”, business planning, etc. are gone away.
To monitor and search the business opportunities in the new global market we need not the model simulation but “digital intelligence” (AI) which will analyze the dynamic of collective market behavior and provide the psychoanalysis of business activity : – ) )
Sergei
Thanks for your input Sergei. However, the purpose of Bayesian analysis is not prediction, but to derive inverse probability by continuing to incorporate new information as it comes in.
– Greg
The Art of Observation and How to Master the Crucial Difference Between Observation and Intuition | Brain Pickings
http://www.brainpickings.org/index.php/2013/03/29/the-art-of-observation/
Maria Popova is always worth a look:-)
Hi Greg,
Would love to get some more directions as to how we, as a startup, could plan better.
Any specific case study for a company navigating through decisions, wether marketing related or not would be great. Thanks beforehand,
Elizabeth.
Great question Elizabeth. There are plenty of them, but here’s a new article about Facebook by Kirt Eichenwald, which describes how they take an agnostic approach to new initiatives until they see how the data pans out: http://www.vanityfair.com/business/2013/05/facebook-future-mark-zuckerberg-sheryl-sandberg?
They are constantly running experiments, doing A/B testing and getting better all the time. The don’t have plans as much as principles.
– Greg
Fact based intuition works for me!
Provactive article, thanks.