Estimating measurement uncertainty, top-down Measurement uncertainty need not be built piece by piece from every pipette and balance. The top-down approach assembles it from the imprecision and bias a method validation already measures.

Measurement uncertainty (MU) is a quantity attached to a result that says how far the true value could reasonably sit from the number reported. ISO 15189 asks clinical laboratories to estimate it for the quantities they report.

The prospect sounds daunting only if you picture the bottom-up route: enumerating every individual source of error and propagating them. For a clinical measurement procedure there is a more direct path, and it reuses work you have already done.

Top-down versus bottom-up

The bottom-up method, from the GUM tradition, builds an uncertainty budget component by component. Every volume, mass and calibration contributes a term. That approach suits a metrology institute characterising a reference procedure.

The top-down method, set out in the Nordtest guidance and CLSI EP29, works from the whole-procedure performance instead. The top-down approach takes the long-term imprecision and the bias that a validation or verification study already estimated, and combines them. For a routine measurement procedure that is both more practical and more realistic, because it captures the real variation the method shows in use rather than a theoretical sum of parts.

The two components you already have

Top-down uncertainty rests on two components. The first is imprecision, ideally the long-term, within-laboratory standard deviation from a precision study of the kind EP05 produces. That figure already contains between-run and between-day variation, which is the day-to-day scatter a reported result is subject to.

The second is uncertainty in the bias: not the bias correction itself, but how well that correction is known. That comes from a trueness study against a reference material, or a comparison against a reference method, of the kind EP15 or EP09 produces. A validation that followed the usual protocols has already measured both components.

A top-down uncertainty budget: a within-laboratory imprecision component and a bias-uncertainty component combine in quadrature into a combined standard uncertainty, which is then multiplied by a coverage factor of two to give the expanded uncertainty.
Two components (within-laboratory imprecision and the uncertainty of the bias) combine in quadrature into a combined standard uncertainty, then expand by a coverage factor to the interval you report.

Combining and expanding

The two components combine in quadrature. The combined standard uncertainty is the square root of the sum of their squares, because independent uncertainties add as variances, not as values. The result is the standard uncertainty, the equivalent of one standard deviation.

To report an interval a clinician can use, multiply by a coverage factor, conventionally k = 2, giving roughly 95% coverage, to get the expanded uncertainty, U. A result is then reported as the value plus or minus U.

For example, a within-laboratory imprecision of 2.0% and a bias uncertainty of 1.0% combine to a standard uncertainty of √(2.0² + 1.0²) = 2.2%. At k = 2 that becomes an expanded uncertainty of about 4.5%, and the expanded uncertainty is the interval reported around each result. Whether uncertainty is expressed in the unit of measurement or as a percentage depends on how imprecision behaves across the interval. Where it is roughly proportional, a relative uncertainty is the more useful form.

What top-down does and does not cover

Top-down uncertainty is only as complete as the study behind it. A precision estimate from a single run understates the day-to-day variation a reported result actually carries, so use the longest-term imprecision you have.

A known bias that has not been corrected must be accounted for separately. The guides differ on how: some adding it as an extra term, others widening the interval to cover it. An uncorrected bias is not the same as a small one. State the components (the imprecision term, the bias-uncertainty term and the coverage factor) so a reader can see what the interval is built from.

Downloads

Download the CLSI EP15-A3 example workbook (.xlsx): a precision and trueness verification producing the within-laboratory imprecision and the bias estimate that a top-down uncertainty is built from, ready to open in the Analyse-it trial.

Common mistakes

Using repeatability as the imprecision term. Within-run scatter alone understates what a result reported on any given day is subject to. Use the long-term, within-laboratory SD.

Confusing the bias with its uncertainty. The uncertainty budget needs how well the bias is known, not the bias value. Correct the bias where you can, and carry the uncertainty of the correction.

Adding components linearly. Independent uncertainties combine in quadrature, not by simple addition. Square each component, sum them, then take the square root.

Omitting the coverage factor. A bare standard uncertainty is not the 95% interval a clinician expects. State k, and report the expanded uncertainty.

Assemble a top-down uncertainty with Analyse-it

Analyse-it produces the two components a top-down uncertainty is built from, inside Excel:

  • Long-term within-laboratory imprecision, from a precision study (EP05-A3)
  • Bias with its confidence interval, from a trueness or comparison study (EP15-A3, EP09-A3)
  • Both from data you already have, if the validation studies were run

Every feature from all five editions for 15 days, with no sign-up and no licence key. Precision and bias estimation are in the Method Validation and Ultimate editions, from US$ 475 a year. Validated against NIST and CLSI reference datasets. See total error or measurement uncertainty for how the two frameworks compare.