Statistics add-in software for statistical analysis in Excel
  • Statistical Reference Guide
  • Fit model
  • Linear fit

Multiple comparison procedures for the effect means in a linear model

Methods of controlling the Type I error and dependencies between point estimates when making multiple comparisons between effect means in a linear model.

Procedure Purpose / Assumptions
Student's t (Fisher's LSD) Compare the means of each pair of groups using the Student's t method.

When making all pairwise comparisons this procedure is also known as unprotected Fisher's LSD, or when only performed following significant ANOVA F -test known as protected Fisher's LSD.

Controls the Type I error rate individually for each contrast.

Tukey-Kramer Compare the means of all pairs of groups using the Tukey-Kramer method.

Controls the error rate simultaneously for all k(k+1)/2 contrasts.

Hsu Compare the means of all groups against the best of the other groups using the Hsu method.

Controls the error rate simultaneously for all k contrasts.

Dunnett Compare the means of all groups against a control using the Dunnett method.

Controls the error rate simultaneously for all k-1 contrasts.

Scheffé Compare the means of all groups against all other groups using the Scheffé F method.

Controls the error rate simultaneously for all possible contrasts.

Bonferroni Not a multiple comparisons method. It is an inequality useful in producing easy to compute multiple comparisons. In most scenarios, there are more powerful procedures such as Tukey, Dunnett, Hsu.

A useful application of Bonferroni inequality is when there are a small number of pre-planned comparisons. In this case, use the Student's t (LSD) method with the significance level (alpha) set to the Bonferroni inequality (alpha divided by the number of comparisons). In this scenario, it is usually less conservative than using Scheffé all contrast comparisons.

Related concepts
Multiple comparisons
Related tasks
Comparing effect means
Related information
Hsu, J. C. (1996). Multiple Comparisons: Theory and Methods. CRC Press.
Available in Analyse-it Editions
Standard edition
Method Validation edition
Quality Control & Improvement edition
Ultimate edition

  •  What is Analyse-it?
  •  What's new?
  •  Administrator's Guide
  •  User's Guide
  •  Statistical Reference Guide
  •  Distribution
  •  Compare groups
  •  Compare pairs
  •  Contingency tables
  •  Correlation and association
  •  Principal component analysis (PCA)
  •  Factor analysis (FA)
  •  Item reliability
  •  Fit model
  •  Linear fit
  •  Simple regression models
  •  Fitting a simple linear regression
  •  Advanced models
  •  Fitting a multiple linear regression
  •  Performing ANOVA
  •  Performing 2-way or higher factorial ANOVA
  •  Performing ANCOVA
  •  Fitting an advanced linear model
  •  Scatter plot
  •  Summary of fit
  •  Parameter estimates
  •  Effect of model hypothesis test
  •  ANOVA table
  •  Predicted against actual Y plot
  •  Lack of Fit
  •  Effect of terms hypothesis test
  •  Effect leverage plot
  •  Effect means
  •  Plotting main effects and interactions
  •  Multiple comparisons
  •  Multiple comparison procedures
  •  Comparing effect means
  •  Residual plot
  •  Residuals - normality
  •  Residuals - independence
  •  Plotting residuals
  •  Outlier and influence plot
  •  Identifying outliers and other influential points
  •  Prediction
  •  Making predictions
  •  Making inverse predictions
  •  Saving variables
  •  Logistic / Probit fit
  •  Study design
  •  Method comparison / Agreement
  •  Measurement systems analysis (MSA)
  •  Reference interval
  •  Diagnostic performance
  •  Survival/Reliability
  •  Control charts
  •  Process capability
  •  Pareto analysis
  •  Study Designs
  •  Bibliography



Version 6.15
Published 18-Apr-2023
statistics software, statistical software for Excel
  • Products
  • Store 
  • Support
  • Blog
  • About us
  • Download trial
  •  Search
  •  Sign in
  •  Contact us
Analyse-it editions
  • Standard edition
  • Medical edition
  • Method Validation edition
  • Quality Control & Improvement edition
  • Ultimate edition

  • Blog  
  • About us
  • Contact us  
  • Privacy policy


Copyright 2026 Analyse-it Software, Ltd, Leeds, United Kingdom .
We use essential cookies to run the site, and optional analytics to improve the experience for visitors. For more information see our Privacy policy.