Bland-Altman agreement software for clinical research The standard method comparison analysis for clinical research. Limits of agreement with mean, median and linear fit bias, constant and non-constant precision, mountain plots, replicate handling and qualitative agreement measures.

Every feature from all five editions for 15 days.
Medical edition from US$ 340 a year · 30-day money-back guarantee.

Microsoft Excel with the Analyse-it tab selected, showing the Bland-Altman difference plot for sodium from CLSI EP21-A Table 3, 125 samples: the differences candidate minus average plotted against the average, the 95% limits of agreement and the plus or minus 4 mmol/L allowable difference band, with the Method Comparison task pane open on Fit Differences. Handwritten notes: Runs inside Excel: every analysis is on the Analyse-it tab; Difference plot with the bias, limits of agreement and the allowable difference band; Bias model, limits and their confidence levels; The report is an ordinary Excel worksheet: share it, archive it, open it on any PC with Excel.

See the agreement between two measurement methods

Excel’s CORREL function and chart trendline tell you two methods are related and stop. Correlation does not tell you the methods agree. The question is whether the two agree well enough for clinical use. You ask it when you introduce a new analyser, switch reagent systems or compare a point-of-care device against a laboratory method. The Bland-Altman difference plot answers it. The plot shows the bias between the methods, how it varies across the measuring range and where the limits of agreement fall against what is clinically acceptable.

Is the bias constant, or does it depend on concentration? Do the limits of agreement fall inside the allowable difference, and how wide is the uncertainty on the limits themselves? Were the samples measured in duplicate, and does the analysis use that? And for a test that reports positive or negative, how often do the two methods agree beyond chance?

Difference plot, histogram of differences and mountain plot

Every difference between the two methods on one plot: the differences against the mean of the methods or against X. The bias and the 95% limits of agreement are drawn on the plot, with a histogram of the differences alongside. Overlay an allowable difference — ±4 mmol/L for sodium or ±10 mg/dL for LDL cholesterol — to see at once whether agreement meets the clinical requirement. Plot the difference, the relative difference or the ratio, colour the points by a factor and check the scatter plot with its identity line. The mountain plot, a folded empirical CDF, shows the whole distribution of differences as a single curve with the same allowable difference band. The proportion outside the requirement is visible at once. The mountain plot is a useful complement to the difference plot when presenting to an audience unfamiliar with limits of agreement.

  • Difference / relative difference / ratio plot against X or mean of methods with allowable difference band and histogram
  • Linear or log X-axis on difference plots new in v5.51
  • Mountain plot with allowable difference band
  • Scatter plot with identity line
  • Vary colour of points by a factor
  • Allowable difference specification and overlay
Microsoft Excel showing the mountain plot of a Bland-Altman report for LDL cholesterol from CLSI EP21-A Table 2, 100 samples: the folded cumulative distribution of the differences Y minus X with the plus or minus 10 mg/dL allowable difference band, N and the minimum and maximum of each method beneath, with the task pane open. Handwritten notes: Mountain plot: the folded CDF of the differences, with the allowable difference band; Median bias and the 95% limits of agreement; Mountain plot: one tick.
LDL cholesterol, 100 samples, from EP21-A Table 2: the mountain plot of the differences Y − X with the ±10 mg/dL allowable difference band.

Mean, median and linear fit bias with constant or non-constant precision

The bias model should match the differences, so three are available in one analysis. Mean bias and median bias, each with a confidence interval, for differences that are centred or skewed. A linear fit on the difference plot separates constant bias (the intercept) from concentration-dependent bias (the slope), so you can judge whether either is clinically meaningful. Limits of agreement are horizontal when precision is constant, and regression-based (V-shaped) when it is not. The limits then widen or narrow with concentration rather than assuming the same variability everywhere.

  • Mean bias with confidence interval
  • Median bias with confidence interval
  • Linear fit for concentration-dependent bias
  • Limits of agreement — constant precision (horizontal)
  • Limits of agreement — non-constant precision (regression-based)
Microsoft Excel showing the Fit Differences section of a Bland-Altman report for LDL cholesterol from CLSI EP21-A Table 2: the median difference with its 90% confidence interval and the 95% lower and upper limits of agreement, with the task pane open on Fit Differences. Handwritten notes: Median bias with its 90% CI, and the 95% limits of agreement; Bias model: mean, median or linear fit.
Median bias for the LDL cholesterol differences: the median difference 2.00 mg/dL with its 90% CI and the 95% limits of agreement. The bias model is chosen in the task pane.

Confidence intervals on the limits of agreement, and Pearson r

A limit of agreement is an estimate, and its uncertainty matters most when the limit sits close to the allowable difference. Confidence intervals are reported on the upper and lower limits of agreement as well as on the bias. The intervals give the uncertainty in the agreement boundary, not only in the central estimate. Pearson r is reported for readers who expect it, as a measure of how closely the methods are related rather than of agreement.

  • Confidence intervals on limits of agreement
  • Non-parametric (percentile) limits of agreement
  • Limits of agreement for single measurements or for the mean of replicates
  • Pearson r correlation coefficient
Microsoft Excel showing the Fit Differences section of a Bland-Altman report for sodium from CLSI EP21-A Table 3, 125 samples: the mean difference and the 95% lower and upper limits of agreement, each with a 90% confidence interval and standard error, and the SD of the differences, with the task pane open on Fit Differences. Handwritten notes: Mean difference and the limits of agreement, each with a 90% CI; Confidence level on the limits.
Sodium, 125 samples, from EP21-A Table 3: the mean difference and the 95% limits of agreement, each with a 90% confidence interval and standard error.

Replicate measurements with within-subject variance estimation

Averaging replicates before the analysis hides the within-subject variation and narrows the limits. Singlicate, duplicate and replicate measurements are all handled correctly. Within-subject variation is estimated from the replicates and the confidence intervals adjusted accordingly. The precision of each method, as SD or CV, is reported alongside.

  • Singlicate, duplicate and replicate measurements
  • Within-subject variance estimation from replicates
  • Precision (SD or CV) for each method
  • Reduce or partition measuring interval

Qualitative agreement: positive/negative agreement, kappa, weighted kappa

Not every comparison is of quantitative measurements. The proportions in positive agreement (PPA) and negative agreement (NPA) quantify concordance when two methods report a binary outcome, positive or negative. Each comes with Clopper-Pearson exact or Wilson score confidence intervals. Kappa and weighted kappa correct for chance agreement, with a kappa test for agreement beyond chance.

  • Proportion in positive/negative agreement (PPA/NPA) with Clopper-Pearson exact or Wilson score CI
  • Kappa and weighted kappa (linear or quadratic weights) with Wald Z CI
  • Kappa test for agreement
  • Bangdiwala agreement plot new in v5.60
  • Dice-Sørensen average agreement new in v5.60

Example analyses

See Bland-Altman agreement results in detail — difference plots, limits of agreement and mountain plots — using example datasets you can download and follow along with.

EP21 A Example 1 2 pages EP21-A — Table 2
LDL cholesterol total analytical error.
100 observations. Difference plot and mountain plot with an allowable difference of ±10 mg/dL, median difference with a 90% CI and 95% limits of agreement.

Part of the Medical edition

Bland-Altman agreement is one part of the Medical edition, alongside diagnostic accuracy, reference intervals and survival analysis. The edition also includes the full Standard edition for hypothesis testing, regression and descriptive statistics.

Related guides in the Learn section: Bland-Altman limits of agreement explained and why correlation is the wrong statistic.

For the rest of a method validation programme — precision, linearity, detection limits, bias at clinical decision points, regression-based method comparison and reference-interval transference — see the Method Validation edition.

Software you can trust

Validated calculations you can defend at peer review Every calculation is performed by Analyse-it — no Excel formulas, no third-party functions. Results are validated against published datasets and thousands of internal test cases before every release. How Analyse-it is developed and validated →
Patient data stays on your PC Analyse-it runs entirely within Microsoft Excel on your PC. No cloud processing, no data transmission. Patient data and research data stay within your facility under your own data governance controls.
Standard Excel workbooks anyone can open Every analysis is an ordinary .xlsx workbook. Share with co-authors, attach to a manuscript submission, archive for publication queries. No proprietary format, no licence required to view results. Co-authors and reviewers see exactly what you see.
Results that cannot be accidentally broken Analysis output contains computed values, not formulas. Nothing to accidentally overwrite, no cell references to break, no formula errors to introduce. The results you published are exactly what you will find when you reopen the workbook months or years later, when a reviewer asks.

Free trial and pricing

Try it on your own data first. The 15-day trial is every feature from all five editions — install it and start straight away.

Medical edition: US$ 340 per year or US$ 815 for a perpetual licence. Every purchase carries a 30-day money-back guarantee. Need a quote for purchasing? Add the licence to the cart and save it as a PDF quote.