Binary Criteria Screen

Thinking Tools5.2 Selecting the Right Decision ToolsAlso known as Pass-Fail Screen

Draws on the musts screen of Charles H. Kepner and Benjamin B. Tregoe (The Rational Manager, 1965) and on Stuart Pugh's concept selection (Total Design, 1991).

Scores each option pass or fail against a few disqualifying criteria and keeps only the options that pass every one, with no weights and no totals.

Four office options through three pass or fail tests, before any scoring

A 140-person firm whose lease ends next year. Each option passes or fails each must, and one fail puts it out, whatever else it has going for it: remote work is the staff's favorite and still goes out, because the hardware lab cannot leave the building. Change a pass to a fail (downtown on the budget, say) and watch the survivors shrink to one, or to none. Illustrative.

Fits this year's capital budget of $1.5M

MustStay and refitMove downtownGo fully remoteWait a year

Keeps the hardware lab and its test benches on site

MustStay and refitMove downtownGo fully remoteWait a year

Seats the 40 people in the signed hiring plan by next fall

MustStay and refitMove downtownGo fully remoteWait a year

Passes every mustNo option passes every must: take the musts back to their owners, or find a new option.Stay and refitMove downtownStay and refit and Move downtownGo fully remoteStay and refit and Go fully remoteMove downtown and Go fully remoteStay and refit, Move downtown, and Go fully remoteWait a yearStay and refit and Wait a yearMove downtown and Wait a yearStay and refit, Move downtown, and Wait a yearGo fully remote and Wait a yearStay and refit, Go fully remote, and Wait a yearMove downtown, Go fully remote, and Wait a yearStay and refit, Move downtown, Go fully remote, and Wait a year

An example

A 140-person engineering firm had a lease ending in fourteen months and four options on the table: refit the current building, move to a downtown floor, go fully remote, or sign a one-year extension and decide later. The leadership team had spent two meetings on a weighted scorecard, and the totals kept shifting with whoever had set the weights last. Remote work led every version, on staff preference and cost.

The operations director set the scorecard aside and asked a narrower question: what would rule an option out entirely, whatever it scored? Three things did. The plan had to fit this year's $1.5 million capital budget, keep the hardware lab and its test benches on site, and seat the forty people in the signed hiring plan by next fall. Marked pass or fail, fully remote failed on the lab and the one-year extension failed on seats, since the current building was already full without a refit. Two options survived, and the next meeting compared only those two, on commute and cost, in forty minutes.

Why it works

A weighted score lets strengths buy back weaknesses. That is the right behavior for preferences and the wrong one for requirements: no amount of staff enthusiasm moves a test bench into a living room. When a hard limit sits inside a total, a high score elsewhere can carry an option that cannot actually be done, and the discussion turns into an argument about weights.

The screen takes the requirements out of the arithmetic. Each one is a yes or no, and one no ends the option. Because there are no weights to argue, the debate moves to the honest questions: is this criterion really a requirement, and does this option really fail it? Whatever survives can then be compared on preferences without anything impossible in the running.

The thinking behind it

Charles Kepner Charles Kepner, a management consultant, founded the firm Kepner-Tregoe with Benjamin Tregoe in 1958. Their book The Rational Manager (1965) set out step-by-step methods for problem analysis and for decision analysis, in which a choice is weighed against criteria. The screen draws on the part of that method that separates the musts, the requirements every option has to meet, from the wants that are weighed and scored.

Benjamin Tregoe Benjamin Tregoe, Kepner's partner, started the firm with him in 1958 and wrote The Rational Manager (1965) and The New Rational Manager (1981) with him. The later book added Situation Appraisal, for sorting and ranking a crowd of concerns before deciding which to work on. In their decision analysis an option that fails a must leaves the decision before any wants are scored, which is the move this screen keeps on its own.

Stuart Pugh Stuart Pugh, a British professor of engineering design, developed concept selection, set out in Concept Selection: A Method That Works (1981) and in Total Design (1991). Candidate designs are compared with a chosen baseline, criterion by criterion, as better, the same, or worse, and the leaders are strengthened and compared again. His method shares the screen's preference for coarse, honest judgments over precise-looking scores.

How to run it

  1. List every option. Include doing nothing and waiting, which often fail a must nobody had named.
  2. Name three or four disqualifiers. Write only the conditions that would end an option on their own, such as a legal limit, a budget ceiling, or a date.
  3. Move the preferences out. Anything where more is better, such as cost or comfort, goes to a weighted comparison later.
  4. Write each must as a test. Phrase it so a stranger could mark it pass or fail from the facts, with a number or a date in it.
  5. Mark every cell pass or fail. Allow nothing in between; a maybe means a fact is missing, so go and get it.
  6. Keep only what passes everything. One survivor is the decision, several go to the weighted comparison, and none sends the musts back to their owners.

Where it goes wrong

The usual failure is a long list of musts. Ten disqualifiers, several of them really preferences, knock out every option, and the team starts treating some fails as passes. If a must keeps getting relaxed, it was a want; move it to the scoring.

The opposite slip is a vague must. A test such as fits our culture can be marked either way, so the screen ends up confirming whatever the room already favored. Rewrite each one until two people marking it apart would agree.

The third is screening too late. A team that has already picked a favorite tends to write musts that only the favorite passes. Write the tests before anyone scores an option.

When to use something else

  • Weighted Decision Matrix. When the survivors differ on several preferences of unequal importance and need a ranked comparison.
  • Kepner-Tregoe Method. When the decision also needs its risks worked through, after the musts and the weighted wants.
  • Constraint Satisfaction. When the requirements apply to combinations of choices, such as a site with a date and a layout, and no single option can be tested alone.

Where it sits in SOLVE eX

Go to the source

  • The Rational Manager: A Systematic Approach to Problem Solving and Decision Making, 1965
  • Total Design: Integrated Methods for Successful Product Engineering, 1991

Back to the catalog