Key Points
- A Gage R&R is a study conducted during the MSA process.
- It acts as a way of determining if your measurements from data points are truly accurate.
- The results from the study can be used to determine is a process is truly precise or not.
Gage R&R is all about the integrity of your measurement system and its ability to capture the true values of what you are measuring. A few quotes on measurement and data might be appropriate:
“In God we trust. All others must bring data.” — W. Edwards Deming
“One accurate measurement is worth one thousand expert opinions.” — Grace Hopper
“It is really just as bad a technique to make a measurement more accurately than is necessary as it is to make it not accurately enough.” — Arthur David Ritchie
This article will present what is a Gage R&R study, some definitions and underlying statistics, the benefits of doing a Gage R&R study, and some best practices for successfully doing one.
Overview: What is Gage R&R?
A Gage R&R is a scientific study that falls under the larger topic of Measurement System Analysis (MSA). When you observe any measurement, it will typically vary from time to time. That variation in the observed measurement will be the result of the variation in the object that you are measuring plus the variation of the measuring device.
For example, when you get on the bathroom scale each morning, the scale reading is usually different. That variation will be the variation in your weight plus the variation in the scale mechanism. The Gage R&R helps you distinguish how much of the variation is due to the scale mechanism.
If the proportion of scale mechanism variation is a large part of the overall variation, then you won’t know your true weight — or whether your new diet is working. The Gage R&R study specifically measures the repeatability and reproducibility of the measurement system.
Repeatability is your ability to measure the same thing multiple times with the same measuring device, under the same circumstances and get the same answer. Reproducibility is the ability of you and your friend Charles to measure the same thing multiple times with the same measuring device, under the same circumstances and both of you get the same answer.
How Does a Gage R&R Study Work?
The Gage R&R study is a carefully planned process by which you select several “operators,” or people to do the study, and many objects to measure that are known to have inherent variation. You will also choose a measuring device such as a ruler, timer, or scale.
Usually, you’ll select 2-3 people and 5-10 objects. Each person will measure each object multiple times, usually 2-3 times. You are not interested in the actual values but in the variation that exists when a person measures an object multiple times and the variation that will exist between the different people who are measuring the same object.
The purpose of the same person measuring each object multiple times is to assess the repeatability of the measurement system. Using multiple people to measure the same object multiple times will assess the reproducibility of the measurement system.
Calculations of the variance are made of the overall variation of the process plus the variation due to the repeatability and reproducibility. The results are then presented as a ratio of the repeatability and reproducibility and the overall variation. This is expressed as a percentage contribution of the R&R as a function of the overall variation.
Generally recognized criteria for gage acceptability is when Gage R&R variability to overall process variability is:
- Under 10%: Acceptable Gage
- 10% to 30%: May be acceptable
- Over 30%: Gage is unacceptable and should be corrected or replaced
Why It Matters
How can you be sure your processes are working as intended if the observed measurements are off? When it comes down to it, what makes the Gage R&R test such a boon to implement in your analysis is that it is readily repeated. If you’re not seeing variances, then your process planning has succeeded.
Benefits of Gage R&R
If you want to make good data-driven decisions, you must have faith that your measurement system is providing good data. Here are a few of the benefits of doing a Gage R&R study.
Provides a Good Measure of the Process’s Precision
While you want your measurement system to provide both accuracy and precision, the Gage R&R deals strictly with the precision component of measurement variation and provides a simple percentage contribution of measurement variation as a function of overall variation. You want as little contribution from measurement issues versus actual process variation as possible.
Extensive Computations Can Be Done Using Statistical Software
To fully compute the contribution of R&R, there are several detailed statistical computations you must do. Fortunately, many statistical software applications can do the calculations for you. But, you must properly design and execute the study, otherwise the results will be meaningless.
Efficiency of Design
A properly designed Gage R&R study will allow you to understand the variation of your process with minimal use of resources and in a relatively short period. Previously, we discussed using 2-3 people, 5-10 objects, and 2-3 repeated measurements. With good planning, this can be accomplished in a reasonable amount of time.
Why Is Gage R&R Important to Understand?
Your process varies whether you like it or not. You must understand how much of that variation is due to the process that you are measuring or due to the variation in the measurement system or device.
Better Data-Driven Decisions
If you are making decisions based on data captured from a flawed measurement system, your decisions may not be the right ones. The Gage R&R will help you make better decisions.
Most Problems with Measurement Systems Have a Simple Solution
Knowing whether your measurement system issue is due to repeatability or reproducibility will point you in the proper direction for correcting and improving your measurement system. Many times, there may be an easy solution to your problem.
Variation is Often Called Evil
You must always strive to reduce variation in your process. You can’t change what you don’t understand, and you can’t understand what you can’t measure. Having a reliable and trustworthy measurement system will allow you to understand your process better and, therefore, reduce the variation.
Completing a Gage R&R Study with a Real-world Example
While many people often associate Gage R&R and MSA with a manufacturing process, it is just as applicable to non-manufacturing processes. A finance department was getting complaints from its customers that the process of applying credits on invoices was very variable and unpredictable.
The CFO approached one of the company’s MBBs, Lora, and asked her to help. Lora knew immediately that she would need to do a Gage R&R study.
Three clerks were chosen to participate in the study. Ten random customer invoices were selected. Lora decided to have each clerk measure the 10 invoices three times to determine the repeatability and reproducibility of the measurement system.
The senior finance manager had already evaluated each invoice and determined the correct amount that should have been credited. The value that the study was measuring was how many dollars the clerks credited to each invoice.
After the study, Lora ran all the data through a statistical software program and found the issues. Unfortunately, the percentage contribution of R&R was 25%, which put it in the range of barely acceptable.
She broke that down and found that while the repeatability was acceptable, the reproducibility seemed to be the issue. Each clerk was interpreting the correct credits differently. Lora also found out there was a bias — the clerks were consistently applying a higher credit than the finance manager was.
Working with the finance manager, Lora developed some better operational definitions and training for the clerks. It took a few weeks for the changes to impact the invoice process, but then things got more consistent, and the customer complaints stopped.
Best Practices When Thinking About Gage R&R
Planning and executing a Gage R&R study is critical to getting meaningful results. Here are a few tips for conducting one.
Select People for the Study That Do the Process
Don’t add a source of variation by selecting study participants who are not experienced or don’t do the process as a natural part of their job.
Remove any Bias by Having the Participants Measure the Objects in Random Order
You don’t want people to bias the study by “remembering” previous measurement values. Randomize the objects so that they have to measure the object rather than being able to rely on memory.
Do the Study as Part of the Natural Process
Don’t insert an artificial feeling into the study. Run the process as normally as you would. People will be nervous participating as it is. Don’t contaminate the study with any extraneous variation or noise.
Other Concepts to Increase Your Production Quality
So, what are the other aspects of Measurement Systems Analysis? Luckily for you, we’ve been working hard behind the scenes to give you the full details of the most useful tools and concepts found in MSA. If you’d like to see the common mistakes to avoid when using MSA, you’ll want to read our cautionary article.
Likewise, you’ll need a production workflow hinged on reproducibility if you’re looking to deliver the best possible products. Understanding how it integrates into your workflow for consistent and reliable measurements is going to save a lot of time and headaches.
Wrapping Up Gage R&R
The goal of a Gage R&R study is simple. It is designed to allow you to identify what proportion of the variation for your observed data is caused by the actual variation of what you are measuring and the variation due to the measuring device. Specifically, you are looking at the repeatability and reproducibility of the system.
If your measurement system has a problem with being repeatable or reproducible, you need to take action to mitigate or eliminate the reasons so you can trust your data. To paraphrase Dr. W. Edwards Deming, “Without (trustworthy) data, you’re just another person with an opinion.”