Statistics add-in software for statistical analysis in Excel
  • Statistical Reference Guide
  • Method comparison / Agreement

Estimating agreement between two binary or semi-quantitative methods

Measure the agreement between a test method and a reference or comparative method when both variables are binary or semi-quantitative.

  1. Select a cell in the dataset.
  2. On the Analyse-it ribbon tab, in the Statistical Analyses group, click Method Comparison (or Agreement depending on the edition), and then click Binary (PPA/NPA) or Semi-Quantitative.
    The analysis task pane opens.
  3. In the X drop-down list, select the comparative or reference measurement procedure, or the first observer/factor variable.
  4. In the Y drop-down list, select the test measurement procedure, or the second observer/factor variable.
  5. If the data are in frequency form, in the Frequency drop-down list, select the frequency count variable.
  6. In the Measure drop-down list, select the measure of agreement:
    Option Description
    Reference Compute the proportion of the Y (Test method) that agree with the X (Reference / Comparative method). Useful to make comparisons against a reference method or the current laboratory method. Note: This method is asymmetric and the agreement is different depending on the assignment of X and Y.
    Average Compute the Dice-Sorenson measure of average agreement. Useful when comparing say 2 observers or laboratories where neither is a natural comparator. Note: This method is symmetric and doesn't depend on assignment of X and Y.
  7. On the Analyse-it ribbon tab, in the Method Comparison group, click Estimate and then select an overall agreement estimator.
  8. Click Calculate.
Related concepts
Agreement plot
Agreement measures for binary and semi-quantitative data
Chance corrected agreement measures for binary and semi-quantitative data
Related reference
Study design for qualitative methods
Available in Analyse-it Editions
Method Validation edition
Ultimate edition

  •  What is Analyse-it?
  •  What's new?
  •  Administrator's Guide
  •  User's Guide
  •  Statistical Reference Guide
  •  Distribution
  •  Compare groups
  •  Compare pairs
  •  Contingency tables
  •  Correlation and association
  •  Principal component analysis (PCA)
  •  Factor analysis (FA)
  •  Item reliability
  •  Fit model
  •  Method comparison / Agreement
  •  Correlation coefficient
  •  Scatter plot
  •  Fit Y on X
  •  Fitting ordinary linear regression
  •  Fitting Deming regression
  •  Fitting Passing-Bablok regression
  •  Linearity
  •  Residual plot
  •  Checking the assumptions of the fit
  •  Average bias
  •  Estimating the bias between methods at a decision level
  •  Testing commutability of other materials
  •  Difference plot (Bland-Altman plot)
  •  Fit differences
  •  Plotting a difference plot and estimating the average bias
  •  Limits of agreement (LoA)
  •  Plotting the Bland-Altman limits of agreement
  •  Mountain plot (folded CDF plot)
  •  Plotting a mountain plot
  •  Partitioning and reducing the measuring interval
  •  Agreement measures for binary and semi-quantitative data
  •  Chance corrected agreement measures for binary and semi-quantitative data
  •  Agreement plot
  •  Estimating agreement between two binary or semi-quantitative methods
  •  Study design
  •  Study design for qualitative methods
  •  Measurement systems analysis (MSA)
  •  Reference interval
  •  Diagnostic performance
  •  Survival/Reliability
  •  Control charts
  •  Process capability
  •  Pareto analysis
  •  Study Designs
  •  Bibliography



Version 6.15
Published 18-Apr-2023
statistics software, statistical software for Excel
  • Products
  • Store 
  • Support
  • Blog
  • About us
  • Download trial
  •  Search
  •  Sign in
  •  Contact us
Analyse-it editions
  • Standard edition
  • Medical edition
  • Method Validation edition
  • Quality Control & Improvement edition
  • Ultimate edition

  • Blog  
  • About us
  • Contact us  
  • Privacy policy


Copyright 2026 Analyse-it Software, Ltd, Leeds, United Kingdom .
We use essential cookies to run the site, and optional analytics to improve the experience for visitors. For more information see our Privacy policy.