Estimating agreement between two binary or semi-quantitative methodsMeasure the agreement between a test method and a reference or comparative method when both variables are binary or semi-quantitative.

  1. Select a cell in the dataset.
  2. On the Analyse-it ribbon tab, in the Statistical Analyses group, click Method Comparison (or Agreement depending on the edition), and then click Binary (PPA/NPA) or Semi-Quantitative.
    The analysis task pane opens.
  3. In the X drop-down list, select the comparative or reference measurement procedure, or the first observer/factor variable.
  4. In the Y drop-down list, select the test measurement procedure, or the second observer/factor variable.
  5. If the data are in frequency form, in the Frequency drop-down list, select the frequency count variable.
  6. In the Measure drop-down list, select the measure of agreement:
    Option Description
    Reference Compute the proportion of the Y (Test method) that agree with the X (Reference / Comparative method). Useful to make comparisons against a reference method or the current laboratory method. Note: This method is asymmetric and the agreement is different depending on the assignment of X and Y.
    Average Compute the Dice-Sorenson measure of average agreement. Useful when comparing say 2 observers or laboratories where neither is a natural comparator. Note: This method is symmetric and doesn't depend on assignment of X and Y.
  7. On the Analyse-it ribbon tab, in the Method Comparison group, click Estimate and then select an overall agreement estimator.
  8. Click Calculate.
Available in

From the Statistical Reference Guide for Analyse-it 6.24.0: https://analyse-it.com/docs/user-guide/method-comparison/estimating-binaryagreement

Statistical Reference Guide v6.24.0