Developed by Daniel Kahneman, Dan Lovallo, and Olivier Sibony (Before You Make That Big Decision, 2011).
Runs a proposed decision through a set list of questions about common biases, such as anchoring and overconfidence, before anyone signs off.
Nine bias questions asked of one acquisition memo
A cafe chain's deal team recommends buying a rival for $48 million. Each tag is a question from the checklist, with what the memo and the team show. Select one, then the column for its verdict: flagged, so it needs a fix before the vote, or clear. The first is placed as an example. Illustrative.
- Not placedPlacedClear: move onFlagged: fix it first
- Not placedPlacedClear: move onFlagged: fix it first
- Not placedPlacedClear: move onFlagged: fix it first
- Not placedPlacedClear: move onFlagged: fix it first
- Not placedPlacedClear: move onFlagged: fix it first
- Not placedPlacedClear: move onFlagged: fix it first
- Not placedPlacedClear: move onFlagged: fix it first
- Not placedPlacedClear: move onFlagged: fix it first
- Not placedPlacedClear: move onFlagged: fix it first
The checklist
Asked of this memo and this team, the question is
Your sort matched 0 of 9.Your sort matched 1 of 9.Your sort matched 2 of 9.Your sort matched 3 of 9.Your sort matched 4 of 9.Your sort matched 5 of 9.Your sort matched 6 of 9.Your sort matched 7 of 9.Your sort matched 8 of 9.Your sort matched 9 of 9.
- Clear: move on
- The facts answer the question. Spend the review's time on the flags.
- Flagged: fix it first
- The facts point to a bias at work in the recommendation. Apply the matching fix before the vote.
The sort
- Source of the price: Flagged: fix it first. Anchored. The fix: an independent valuation built from the rival's own cash flows.
- Synergy estimates: Flagged: fix it first. An optimistic base case. The fix: cut synergies to the median that comparable deals actually achieved.
- Dissent in the team: Flagged: fix it first. Dissent dropped on the way up. The fix: a written lease review, and the analysts in the room.
- The deal team's stake: Flagged: fix it first. Self-interest in the recommendation. The fix: diligence by people who gain nothing either way.
- Love for the deal: Flagged: fix it first. Affect. The fix: a premortem, and a serious look at not buying at all.
- Alternatives weighed: Clear: move on. Clear: real alternatives are on the table, with numbers for each.
- Span of the data: Clear: move on. Clear: the evidence is not one good quarter.
- Earlier bets to defend: Clear: move on. Clear: no sunk cost to protect.
- Caution after losses: Clear: move on. Clear: nothing suggests the team is cautious because of past losses.
An example
The board of a regional bakery-cafe chain was due to approve a $48 million acquisition of a smaller rival, recommended by a deal team that would run the combined business. The chair had the finance committee review it first against a list of bias questions, each asked of this memo and this team.
Five questions flagged something. The price had first come from the seller's banker. The synergy estimate sat at the top of the range for comparable deals. Two analysts had raised doubts about the rival's store leases, and the memo did not mention them. The chief executive had wanted this target for five years, and the deal team stood to gain a division. Four questions came back clear: the memo compared three real alternatives, the data covered five years, and there were no earlier bets to defend and no recent losses making anyone timid.
Each flag got its fix: an outside valuation, a haircut on synergies to the median of comparable deals, the lease review, and a premortem. The board approved the deal at $41 million.
Why it works
Knowing that biases exist does little to stop them, because they work inside judgments that feel reasonable to the person making them. A checklist moves the check outside the head. It asks specific questions about this recommendation, such as where the first number came from and who gains if the deal is approved, that a confident team would not think to ask itself.
The questions are aimed at the recommendation and the people behind it, which is why the method works best in someone else's hands: a committee reviewing a team's proposal can see the anchor or the enthusiasm the team cannot. And each question carries its fix. An anchored price gets an independent valuation; an optimistic forecast gets the base rate of similar deals. A flag with no fix attached changes nothing, so the review is finished only when every flag has one.
The thinking behind it
Daniel Kahneman Daniel Kahneman, a psychologist, showed with Amos Tversky that intuitive predictions follow representativeness and neglect base rates and regression to the mean, and proposed correcting them by starting from the record of similar cases, the outside view. With Dan Lovallo and Olivier Sibony, a former McKinsey partner who studies behavioral strategy, he later turned the bias research into a checklist of questions for reviewing a team's recommendation, in Before You Make That Big Decision (2011) in the Harvard Business Review. Thinking, Fast and Slow (2011) is his popular synthesis of the research behind it.
Dan Lovallo Dan Lovallo, a professor of business strategy at the University of Sydney, named the inside view and the outside view of forecasting with Daniel Kahneman, in Timid Choices and Bold Forecasts (1993) and Delusions of Success (2003). They argued that planners should anchor estimates on the outcomes of a reference class of similar past projects. That argument is the fix the checklist applies to an optimistic base case.
How to run it
- Name the decision and who recommends it. Write what is being approved, and what the recommending team stands to gain.
- Have someone else run the list. Give the checklist to reviewers outside the team that wrote the recommendation.
- Ask each question of this case. Answer it with facts from this memo and this team.
- Mark each flagged or clear. A question is flagged when the facts point to the bias at work; expect three to five.
- Attach a fix to every flag. Match each to its remedy: an outside valuation, base rates, a premortem, or a hearing for dissent.
- Decide after the fixes report. Hold the vote until the fixes have changed, or confirmed, the numbers.
- Keep a record of the flags. Note which biases recur in your decisions, and sharpen the list for them.
Where it goes wrong
The checklist is run as a ceremony. Every question gets a quick no, the box is ticked, and the decision goes ahead unchanged. Spot it when nothing is flagged on a large, contested decision; ask for the facts behind each no.
The team reviews its own recommendation. The biases that shaped the proposal shape the review, and it comes back clean. Hand the list to people with no stake in the outcome.
Flags are raised and left without fixes. A note that the price may be anchored, with no outside valuation ordered, changes nothing. Make the fix and its owner part of the flag.
When to use something else
- Premortem. When the decision needs its failure story told in advance by the people who will carry it out.
- Red Teaming. When a separate team should attack the plan as an adversary would, looking for the weakest point.
- Reference Class Forecasting. When the main risk is an optimistic forecast, and the fix is the record of similar past cases.
Where it sits in SOLVE eX
Go to the source
- Before You Make That Big Decision, Harvard Business Review, 2011