Quality & Metrology worked example

Gauge Repeatability with highest repeated reading of 5.03 measured units: a worked example

Suppose highest repeated reading falls to 5.03 measured units. This page works the full calculation at that level so you can see exactly which result moves and by how much. Estimate gauge repeatability from the spread of repeated measurements taken by one operator on the same part with the same gauge.

The inputs for this scenario

  • Highest repeated reading (same part, same operator): 5.03 measured units (the input this scenario stresses; the baseline uses 10.05)
  • Lowest repeated reading (same part, same operator): 9.97 measured units (held at the documented default)
  • Nominal or master (certified reference) value: 10 measured units (held at the documented default)

Working through the calculation

  • The calculation starts from the formula this tool documents: Repeatability range = highest repeated reading − lowest repeated reading.
  • Repeatability variation works out to 49.4 units at these inputs, and this is the headline figure for the scenario.
  • Spread works out to 4.94 value at these inputs.
  • Minimum works out to 5.03 value at these inputs.
  • Maximum works out to 9.97 value at these inputs.

How this compares with the baseline

  • Against the tool's baseline example, where highest repeated reading sits at 10.05 measured units and the headline result is 0 units, this scenario lands almost exactly on the baseline at 49.4 units.
  • It computes the repeatability range (highest minus lowest repeated reading) and the deviation of the reading midpoint from the master value. When the numbers land here, the stressed input is the lever to work; the walkthrough above shows exactly how much each output recovers as it climbs back toward the baseline.

Results at a glance

  • Repeatability variation: 49.4 units (headline result)
  • Spread: 4.94 value
  • Minimum: 5.03 value
  • Maximum: 9.97 value

Run it with your numbers

  • To rerun this with your own numbers, open the live Gauge Repeatability calculator, set highest repeated reading to your actual value, and adjust the remaining inputs to match your operation.

Last reviewed 2026-05-12.