# Lack of Fit

An F-test or X^{2}-test formally tests how well the model fits the data.

When the model fitted is correct the residual (model error) mean square provides and unbiased estimate of the true variance. If the model is wrong, then the mean square is larger than the true variance. It is possible to test for lack of fit by comparing the model error mean square to the true variance.

When the true variance is known, a X^{2}-squared test formally tests whether the model error is equal to the hypothesized value.

When the true variance is unknown, and there are multiple observations for each set of predictor values, an F-test formally tests whether there is a difference between pure error and the model error. The pure error is the pooled variance calculated for all unique sets of predictor values. It makes no assumptions about the model but does assume that the variance is the same for each set of predictor values. An analysis of variance table shows the pure error, model error, and the difference between them called the lack of fit.

The null hypothesis states that the model error mean square is equal to the hypothesized value/pure error, against the alternative that it is greater than. When the test p-value is small, you can reject the null hypothesis and conclude that there is a lack of fit.

**Available in Analyse-it Editions**

Standard edition

Method Validation edition

Quality Control & Improvement edition

Ultimate edition

- What is Analyse-it?
- What's new?
- Administrator's Guide
- User's Guide
- Statistical Reference Guide
- Distribution
- Compare groups
- Compare pairs
- Contingency tables
- Correlation and association
- Principal component analysis (PCA)
- Factor analysis (FA)
- Item reliability
- Fit model
- Linear fit
- Simple regression models
- Fitting a simple linear regression
- Advanced models
- Fitting a multiple linear regression
- Performing ANOVA
- Performing 2-way or higher factorial ANOVA
- Performing ANCOVA
- Fitting an advanced linear model
- Scatter plot
- Summary of fit
- Parameter estimates
- Effect of model hypothesis test
- ANOVA table
- Predicted against actual Y plot
- Lack of Fit
- Effect of terms hypothesis test
- Effect leverage plot
- Effect means
- Plotting main effects and interactions
- Multiple comparisons
- Multiple comparison procedures
- Comparing effect means
- Residual plot
- Residuals - normality
- Residuals - independence
- Plotting residuals
- Outlier and influence plot
- Identifying outliers and other influential points
- Prediction
- Making predictions
- Making inverse predictions
- Saving variables
- Logistic / Probit fit
- Study design
- Method comparison / Agreement
- Measurement systems analysis (MSA)
- Reference interval
- Diagnostic performance
- Survival/Reliability
- Control charts
- Process capability
- Pareto analysis
- Study Designs
- Bibliography

Version 6.15

Published 18-Apr-2023