Steps In the Critical Mistake Analysis Process

CMA methodology, which has been applied to more than 100 programs for dozens of corporations worldwide, has proven effective for individual learners as well as businesses working to align human performance with organizational goals. 

Critical mistake analysis is a five-step process.  Explore the steps of CMA below.
   
Step 1: Identify the critical mistakes
The first step is to identify the mistakes that novices executing targeted skills make. This information is gathered through a combination of surveys, interviews, and on-the-job observations, combined with whatever operational data is available.

Step 2: Identify the most common mistakes
Having identified the mistakes that are being made in the field, our instructional designers then do further analysis to determine the frequency and impact of each mistake. These quantities multiplied together give an estimate of the overall impact of this type of mistake on the organization. The distribution of impacts roughly obeys a Pareto, or "80/20" distribution, which means that the top 20 percent of observed mistakes will typically account for 80 percent of the overall impact of all mistakes. This is captured in a classic Pareto chart, like the one below, which documents the relative impact of mistakes observed for a retail client.


The Pareto chart method is used to prioritize observed mistakes to facilitate the selection of the ones that will receive priority in the training content to be developed - what we call the "critical mistakes."

Step 3: Perform a root cause analysis of the mistake
Once CMA has identified the critical mistakes, the next step is to perform a root cause analysis on each mistake to determine why learners make it. This analysis focuses on three key issues: first, the decision that leads to the mistake; second, the contextual factors that make the mistake likely; and third, the underlying beliefs that lead people to make the wrong decision.

Step 4: Create "teaching points"
The output of a Critical Mistake Analysis is encoded in a set of "teaching points", that encapsulate our understanding of each mistake in a way that facilitates the development of training to remediate it.

Teaching points encompass the material from the root cause analysis combined with the correct alternative to the mistake, and the underlying reasons why this is preferable. In other words, a teaching point encodes a description of a mistake, an analysis of why that mistake is made, and an explanation of how to avoid it and why that is preferable.

Step 5: Build from the teaching points
Once a set of teaching points has been developed based on a critical mistake analysis, the final step is to create training that addresses each of these points effectively. The fundamental approach to this is the goal-based scenario. Goal-based scenarios make it possible for learners to practice skills and acquire relevant experience without the potentially negative consequences of making mistakes in real life. When appropriately designed, such scenarios provide an engaging experience for the student, and can be delivered in a variety of ways.

In a goal-based scenario, the learner is given a mission, or goal, and an opportunity to practice trying to achieve that goal in a realistic environment. As the learner pursues the goal, he or she faces challenges that are based on the teaching points identified through a critical mistake analysis. When the learner makes one of the critical mistakes, he or she is supported with focused coaching designed to help in analyzing the reasons for the mistake, and ultimately, in learning from the experience.

To learn more, please download this white paper about CMA.

Back to Methodology.