Developed by Benjamin S. Bloom with Max D. Engelhart, Edward J. Furst, Walker H. Hill, and David R. Krathwohl (1956), and revised by Lorin W. Anderson and David R. Krathwohl (2001).
Ranks what someone should be able to do with knowledge, from remembering through understanding, applying, analyzing, and evaluating to creating, so goals and tests aim at the intended level.
Eight questions from a new analysts' final test, sorted by the level of thinking each one asks for
The program's goal is analysts who can find why a forecast missed and judge which forecast to trust. The first question is placed as an example. Select each other question, then the level it actually tests; the box gives that level's verbs and a question that would test it. Show the sort to see how much of the test is recall. Illustrative.
- Not placedPlaced1 Remember2 Understand3 Apply4 Analyze5 Evaluate6 Create
- Not placedPlaced1 Remember2 Understand3 Apply4 Analyze5 Evaluate6 Create
- Not placedPlaced1 Remember2 Understand3 Apply4 Analyze5 Evaluate6 Create
- Not placedPlaced1 Remember2 Understand3 Apply4 Analyze5 Evaluate6 Create
- Not placedPlaced1 Remember2 Understand3 Apply4 Analyze5 Evaluate6 Create
- Not placedPlaced1 Remember2 Understand3 Apply4 Analyze5 Evaluate6 Create
- Not placedPlaced1 Remember2 Understand3 Apply4 Analyze5 Evaluate6 Create
- Not placedPlaced1 Remember2 Understand3 Apply4 Analyze5 Evaluate6 Create
Order of thinking
Level within the row
Your sort matched 0 of 8.Your sort matched 1 of 8.Your sort matched 2 of 8.Your sort matched 3 of 8.Your sort matched 4 of 8.Your sort matched 5 of 8.Your sort matched 6 of 8.Your sort matched 7 of 8.Your sort matched 8 of 8.
- 1 Remember
- Recall facts. Verbs: define, list, name. Asks: what is a price variance?
- 2 Understand
- Explain in one's own words. Verbs: explain, summarize, classify. Asks: why can margin fall when sales rise?
- 3 Apply
- Use a method on a new case. Verbs: calculate, use, carry out. Asks: compute the price and volume variances for March.
- 4 Analyze
- Break a whole into parts and find causes. Verbs: compare, break down, trace. Asks: which driver explains most of the third-quarter miss?
- 5 Evaluate
- Judge against criteria. Verbs: assess, defend, choose. Asks: which of two forecasts should the plan use, and why?
- 6 Create
- Put parts together into something new. Verbs: design, build, propose. Asks: design the monthly variance report for a new region.
The sort
- Define variance: 1 Remember. A definition from the handbook: recall, and nothing more.
- List the 4 cost drivers: 1 Remember. A list someone can memorize the night before.
- Name the report's owner: 1 Remember. A fact to recall, with no thinking about variance at all.
- Explain a margin swing: 2 Understand. The analyst has to put the mechanism in words, which shows understanding.
- Compute price variance: 3 Apply. A known method used on new numbers.
- Find what drove Q3 miss: 4 Analyze. Breaking a total into drivers and tracing the cause: the first question that tests the program's goal.
- Judge two forecasts: 5 Evaluate. Choosing between forecasts against stated criteria, the other half of the goal.
- Design a region report: 6 Create. Building something new from the parts the course taught.
An example
A retail chain's finance team ran a six-week course for new analysts, with a final test before each one could own a region's monthly variance report. Analysts kept passing, then struggling in their first month: they could compute a variance but could not say why the region had missed.
The program lead sorted the test's eight questions by the level each one asked for. Three were pure recall: define variance, list the four cost drivers, name the report's owner. One asked for an explanation, one for a calculation, and only three asked for the thinking the job needed: tracing a miss to its drivers, choosing between two forecasts, and designing a report. She rewrote the program's goals with verbs at the level the job required, such as trace the main driver of a monthly miss, and rebuilt the test to match: two recall questions, then a real region's numbers with a miss to explain and two forecasts to choose between. The teaching shifted from definitions to last year's real reports. Pass rates fell at first; first-month escalations fell by half.
Why it works
Tests drift toward recall because recall questions are easy to write and easy to grade. Learners study for the test they will get, so a program that aims at judgment and tests for memory produces memory. The gap only shows later, on the job.
The taxonomy makes the level of each goal and each question explicit. Its six levels run from remembering to creating, and each has verbs that signal it: define and list at the bottom, trace and compare in the middle, judge and design at the top. Writing a goal with a verb from the intended level, then checking that the teaching and the test sit at the same level, lines the three up. Sorting existing questions by level shows at once whether the test measures what the program claims to teach.
The thinking behind it
Benjamin S. Bloom Benjamin Bloom, an educational psychologist, chaired the committee of college examiners that produced the Taxonomy of Educational Objectives: The Classification of Educational Goals. Handbook I: Cognitive Domain (1956), with Max Engelhart, Edward Furst, Walker Hill, and David Krathwohl. The handbook classified learning objectives into a hierarchy from knowledge through comprehension, application, analysis, and synthesis to evaluation. Known as Bloom's taxonomy, it became a standard tool for writing objectives and test questions.
Lorin W. Anderson Lorin Anderson, an educational psychologist and a former student of Bloom, led the 2001 revision with David Krathwohl, published as A Taxonomy for Learning, Teaching, and Assessing. The revision renamed and reordered the levels as Remember, Understand, Apply, Analyze, Evaluate, and Create, putting creating at the top, where the original had placed evaluation. In the revised form, each level names something a learner does, and the top of the scale is making something new.
David R. Krathwohl David Krathwohl, an educational psychologist at Michigan State University, was a coauthor of the original 1956 handbook and coeditor of the 2001 revision with Lorin Anderson. The revision recast the levels as verbs (remember, understand, apply, analyze, evaluate, create), which is what makes the taxonomy practical for writing goals, and added a knowledge dimension, so that the kind of knowledge involved is classified separately from what the learner does with it.
How to run it
- Name the level the job needs. Ask what the learner must do afterward, such as explain a miss or choose a forecast, and find its level.
- Write each objective with a verb at that level. Use trace, compare, judge, or design for higher levels; define and list only where recall is the real need.
- Match the teaching to the level. Higher levels need practice on real cases, and lectures alone rarely get learners there.
- Build the test at the same level. Write each question so that answering it takes the objective's verb; memory of the slides should never be enough.
- Sort the existing questions. Label each by the level it actually tests and count how many sit in recall.
- Rebalance the mix. Keep enough recall to check the basics, and move the weight toward the levels the job requires.
Where it goes wrong
The common failure is a verb that does not match the task. A question that says analyze but can be answered from memory is still recall. Judge a question by what answering it requires, whatever verb it uses.
The second is treating the levels as a ladder every lesson must climb in order. Learners can work at a higher level while still building recall, and real cases often teach both at once. Use the levels to check alignment, and leave the sequence to the content.
The third is aiming high without the basics. A test made only of judgment questions fails learners who never got the vocabulary. Keep some recall, and make sure the teaching builds it.
When to use something else
- Cognitive Apprenticeship. When the skill is an expert's hidden reasoning and the learner needs to see it modeled and then coached.
- Deliberate Practice. When the goal is performance in a skill, built by repeated practice with feedback, beyond what a test can check.
- Zone of Proximal Development. When the question is how much support a learner needs to reach the next level, and who should give it.
Where it sits in SOLVE eX
Go to the source
- Taxonomy of Educational Objectives: The Classification of Educational Goals. Handbook I: Cognitive Domain, 1956
- A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives, 2001