Analyse-it
Analyse-it
  • Products
  • Pricing
  • Support
  • About us
Download trial Sign in
  • Statistical Reference Guide
  • Method comparison / Agreement

Estimating agreement between two binary or semi-quantitative methods

Measure the agreement between a test method and a reference or comparative method when both variables are binary or semi-quantitative.

  1. Select a cell in the dataset.
  2. On the Analyse-it ribbon tab, in the Statistical Analyses group, click Method Comparison (or Agreement depending on the edition), and then click Binary (PPA/NPA) or Semi-Quantitative.
    The analysis task pane opens.
  3. In the X drop-down list, select the comparative or reference measurement procedure, or the first observer/factor variable.
  4. In the Y drop-down list, select the test measurement procedure, or the second observer/factor variable.
  5. If the data are in frequency form, in the Frequency drop-down list, select the frequency count variable.
  6. In the Measure drop-down list, select the measure of agreement:
    Option Description
    Reference Compute the proportion of the Y (Test method) that agree with the X (Reference / Comparative method). Useful to make comparisons against a reference method or the current laboratory method. Note: This method is asymmetric and the agreement is different depending on the assignment of X and Y.
    Average Compute the Dice-Sorenson measure of average agreement. Useful when comparing say 2 observers or laboratories where neither is a natural comparator. Note: This method is symmetric and doesn't depend on assignment of X and Y.
  7. On the Analyse-it ribbon tab, in the Method Comparison group, click Estimate and then select an overall agreement estimator.
  8. Click Calculate.
Related concepts
Agreement plot
Agreement measures for binary and semi-quantitative data
Chance corrected agreement measures for binary and semi-quantitative data
Related reference
Study design for qualitative methods
Available in Analyse-it Editions
Method Validation edition
Ultimate edition

  •  What is Analyse-it?
  •  What's new?
  •  Administrator's Guide
  •  User's Guide
  •  Statistical Reference Guide
  •  Distribution
  •  Compare groups
  •  Compare pairs
  •  Contingency tables
  •  Correlation and association
  •  Principal component analysis (PCA)
  •  Factor analysis (FA)
  •  Item reliability
  •  Fit model
  •  Method comparison / Agreement
  •  Correlation coefficient
  •  Scatter plot
  •  Fit Y on X
  •  Fitting ordinary linear regression
  •  Fitting Deming regression
  •  Fitting Passing-Bablok regression
  •  Linearity
  •  Residual plot
  •  Checking the assumptions of the fit
  •  Average bias
  •  Estimating the bias between methods at a decision level
  •  Testing commutability of other materials
  •  Difference plot (Bland-Altman plot)
  •  Fit differences
  •  Plotting a difference plot and estimating the average bias
  •  Limits of agreement (LoA)
  •  Plotting the Bland-Altman limits of agreement
  •  Mountain plot (folded CDF plot)
  •  Plotting a mountain plot
  •  Partitioning and reducing the measuring interval
  •  Agreement measures for binary and semi-quantitative data
  •  Chance corrected agreement measures for binary and semi-quantitative data
  •  Agreement plot
  •  Estimating agreement between two binary or semi-quantitative methods
  •  Study design
  •  Study design for qualitative methods
  •  Measurement systems analysis (MSA)
  •  Reference interval
  •  Diagnostic performance
  •  Survival/Reliability
  •  Control charts
  •  Process capability
  •  Pareto analysis
  •  Study Designs
  •  Bibliography



Version 6.15
Published 18-Apr-2023
Products
  • Standard Edition
  • Medical Edition
  • Quality Control & Improvement Edition
  • Method Validation Edition
  • Ultimate Edition
  • Compare Editions
  • Pricing
Support
  • Documentation
  • Tutorials
  • Download latest version
  • Release history
  • Contact support
Company
  • About us
  • Blog
  • Contact us
  • Privacy policy

Get Started

  • Download free trial
  • Sign In

© 2026 Analyse-it® Software, Ltd. All rights reserved.

Statistical analysis and method validation software for Microsoft Excel.

We use essential cookies to run the site, and optional analytics to improve the experience for visitors. For more information see our Privacy policy.