Statistics add-in software for statistical analysis in Excel
  • Tutorials
  • Estimating the precision of a measurement procedure (CLSI EP05-A3)

Estimating precision

Estimate the precision of the measurement procedure at a single site.

  1. Open the file tutorials\EP05-A3 Appendix A.xlsx.

    The worksheet opens showing 4 columns. The Sample column identifies the levels of the analyte in the sample (1 level). Day identifies the day number (20 days), Run identifies the run within each day (2 runs per day). Glucose (mg/dL) identifies the measured value for 2 replicates of sample in each run.

  2. Click a cell in the dataset.
  3. On the Analyse-it ribbon tab, in the Statistical Analyses group, click Precision, and then click 2 Factor Nested.
    The analysis task pane opens.
  4. In the Y drop-down list, select Glucose.
  5. In the Factor A drop-down list, select Day.
  6. In the Factor B nested within Factor A drop-down list, select Run.
  7. In the By drop-down list, select Sample.
  8. In the Estimator drop-down list, select SD.
  9. In the Confidence Interval edit box, type 95%, and then in the Method drop-down list, select Exact / Satterthwaite.
  10. In the Conditions drop-down list, select Laboratory / Repeatability to label the innermost variance component repeatability and the outermost within laboratory.
  11. On the Analyse-it ribbon tab, in the MSA group, click Variability plot.
  12. On the Analyse-it ribbon tab, in the MSA group, click Identify Outliers.
  13. Click Calculate.

    The analysis report opens.

The variability plots show a simple visual assessment of the closeness of agreement between the measured quantity values. The purple lines show the mean of each run, the light blue lines show the mean of each day, and the dark blue line the overall grand mean.


EP05 variability plot
You should observe the scatter of the points to ensure there are no obvious problems. No points stand out as atypical relative to the bulk of the data, and there are no discernible trends (such as drift).
Note: To see an example of a dataset that contains outliers and how to deal with them see the EP15-A3 tutorial.

The abbreviated variance components table shows the required precision statistics expressed numerically as the standard deviation (SD) and coefficient of variation (CV).
abbreviated EP05 precision components

The detailed variance components table show the precision expressed numerically as the chosen measure of imprecision along with a confidence interval for each component.
detailed EP05 precision components

Note: You can change the imprecision to be expressed as SD, Variance, or CV and you can also change the method of computing the confidence intervals. We prefer the Exact / MLS method as the coverage is closer the nominal level in most cases.
Next topic: Estimating precision for a multi-site study

  •  Tutorials
  •  Distribution tutorial
  •  Correlation / PCA tutorial
  •  Compare groups means tutorial
  •  Association in 2-way contingency tables tutorial
  •  Simple linear regression tutorial
  •  Bland-Altman method comparison tutorial
  •  Estimating the precision of a measurement procedure (CLSI EP05-A3)
  •  Estimating precision
  •  Estimating precision for a multi-site study
  •  Fitting a precision profile
  •  Evaluating the linearity of a measurement procedure (CLSI EP06-A)
  •  Verifying the precision of a measurement procedure against a performance claim and estimating the bias (CLSI EP15-A3)
  •  Pareto charts tutorial
  •  Process control charts tutorial
  •  Process capability tutorial



Version 6.15
Published 18-Apr-2023
statistics software, statistical software for Excel
  • Products
  • Store 
  • Support
  • Blog
  • About us
  • Download trial
  •  Search
  •  Sign in
  •  Contact us
Analyse-it editions
  • Standard edition
  • Medical edition
  • Method Validation edition
  • Quality Control & Improvement edition
  • Ultimate edition

  • Blog  
  • About us
  • Contact us  
  • Privacy policy


Copyright 2026 Analyse-it Software, Ltd, Leeds, United Kingdom .
We use essential cookies to run the site, and optional analytics to improve the experience for visitors. For more information see our Privacy policy.