Estimate the bias using reference materials.
You should use this procedure when you already have a sample with a known assigned value and you want to estimate the bias and test whether it is signficantly different to zero. It is possible for the bias from a study to be greater than zero due to the chance alone. This procedure ensures that the assumption that the bias is 0 is only falsely rejected 5% of the time when it is in fact true.
The standard error (SE) of the assigned value depends on the source of the assigned value. Reference materials usually are accompanied by a standard uncertainity, whereas proficiency testing materials usually specify the SD and number of laboratories. The standard error (SE) should be computed using the formula in the CLSI document. The degrees of freedom (DF) is usually only used when the sample is PT material and is equal to the number of laboratories minus 1.
CLSI EP15-A3 uses a familywise significance level so the overall significance level is a maximum of 5% regardless of the number of comparisons (for example, for 1 level the significance level is 5%, for 2 levels the significance level is 5%/2 = 2.5% for each level, for 3 levels the significance level is 5%/3 = 1.6% for each level).
The analysis report hypothesis test shows the conclusion for each sample.
All the hypothesis tests are not significant in this example. If any are significant they are highlighted in red and you should contact the manufacturer for further assistant in diagnosing the problem. If the hypothesis test is not statistically significant but the bias estimate is much larger than zero, you may want to repeat the study with more data to be able to detect smaller departures from the zero.
(click to enlarge)