A residual is what the model got wrong for one observation: the value you measured minus the value the model predicted. If the model has captured the structure in the data, what remains should be nothing but noise. Scattered evenly about zero, with no pattern of any kind. Any pattern in a residual plot is structure the model failed to capture, and it is telling you something the summary statistics cannot.
The same logic applies to regression, ANOVA and ANCOVA, which are the same fitted model underneath. The summary statistics — R², F, p — are all computed on the assumption that the model is right, so none of them can tell you whether it is.
Plot residuals against fitted values, or against a predictor. Look for a shapeless horizontal band centred on zero. Four departures from that are worth recognising on sight.
Curvature. Residuals that arch (negative at both ends and positive in the middle, or the reverse) mean you have fitted a straight line to something bent. The fix is in the model, not the data: add a polynomial term, transform a variable, or fit a non-linear form. This is by far the most common finding, and by far the most commonly ignored. A curved relationship can still produce a very high R².
Funnelling. A residual band that widens as the fitted value grows (heteroscedasticity) means the measurement is more variable at high values than at low ones. That is extremely common for anything measured as a concentration or a count. The model’s coefficients may still be reasonable, but the standard errors and intervals are not, because they assume one constant variance. The response is a variance-stabilising transformation, or weighting the fit so precise observations count for more. That is the reasoning behind weighted regression in fitting a calibration curve.
Outliers. A single residual far from the rest. Worth investigating, never worth deleting on the strength of the plot alone. A genuine extreme value is data. A transcription error is not. The plot cannot tell you which one you have.
Drift in sequence. Plot residuals in the order the data were collected. Any trend, cycle or step is evidence that something changed during the run: a drifting instrument, a new reagent lot, a second operator. A lag-1 plot (each residual against the one before it) exposes serial correlation directly. Independence is an assumption of the model, and the one most often violated without anyone noticing.
The residual distribution plot and the normal Q-Q plot address the normality assumption. Be clear how much it actually matters, because it gets more attention than it deserves. Regression and ANOVA assume the residuals are approximately normal, not the response and not the predictors. With a reasonable sample size, moderate departures affect the intervals very little.
A Q-Q plot that bends up at both ends indicates heavy tails. One that curves consistently indicates skew, usually better treated by transforming the response than by abandoning the model. What should concern you is not a slightly wavy Q-Q plot but a badly skewed one. That normally travels together with the funnelling above and has the same fix. Testing normality — and what to do when it fails goes further into when it actually matters.
Leverage measures how unusual an observation’s predictor values are: how far out along the x-axis it sits. Influence measures how much the fitted model would change if you removed it. The two are not the same. A residual plot alone will not show you the difference.
A point with high leverage that lies on the trend has almost no influence. It may even help pin the fit down. A point with high leverage that sits off the trend can drag the entire line towards itself. Having done so, it ends up with a small residual, because the line now passes close to it. That is the dangerous case.
Cook’s D combines both into one number: how much the fitted values as a whole shift when an observation is dropped. An outlier and influence plot (Cook’s D against studentised residuals) separates unusual points from influential ones. If one or two observations are carrying your conclusion, you want to know before you report it, not after a reviewer asks.
R² is the proportion of variance the model explains, and it says nothing about whether the model is the right shape, whether the variance is constant, or whether a handful of points are driving the fit. A curved relationship fitted with a straight line can return R² = 0.98 while being systematically wrong across the range. Being systematically wrong is what matters if you are going to predict from the model.
Two further cautions. R² never decreases when you add a predictor, even a useless one, so it cannot be used to compare models of different sizes. That is what adjusted R², AIC and BIC are for, as covered in building a multiple regression model. Where the fit is a comparison of two measurement procedures rather than a prediction, a high R² is not evidence of agreement at all. That is the subject of why correlation is the wrong statistic for method comparison.
Fit the model. Look at the residual plot for curvature and funnelling. Look at the sequence and lag plots if the data have an order. Look at the outlier and influence plot. Look at the Q-Q plot last, because it is the assumption that matters least. Only then read the coefficients. If any of the first four showed something, change the model and start again. This is an iterative loop, not a checklist, and each pass takes a minute or two.
Download the regression example workbook (.xlsx) — a fitted model with scatter plot and confidence bands, residual plots, leverage plots, and the outlier and influence plot, ready to open in the Analyse-it trial.
The example workbook is downloading.
It opens in Excel on its own — the data and the finished results are both in it. Analyse-it is what lets you change the analysis and re-run it, try the same study on your own data, or work through it to see how the software handles it.
Every feature from all five editions for 15 days, with no sign-up and no licence key.
Reporting a model without ever plotting the residuals. The summary statistics assume the model is right. Only the residuals can tell you whether it is.
Reading a high R² as evidence of a good fit. It measures explained variance, not correctness of form. Curved data fitted with a line can score beautifully.
Deleting outliers because they are outliers. Investigate the observation. Remove it only for a reason you could state to someone else, and report that you did.
Missing the high-leverage point because its residual is small. An influential point pulls the line towards itself and hides in the residual plot. Use Cook’s D.
Fretting about mild non-normality while ignoring funnelling. Non-constant variance damages your intervals far more than a slightly heavy tail does.
Never plotting residuals in run order. Drift and serial correlation are invisible against fitted values and obvious against sequence.
Analyse-it produces the full diagnostic set for every model fitted in Fit Model:
Every feature from all five editions for 15 days, with no sign-up and no licence key. Regression and ANOVA are part of the Standard edition, so it is in every Analyse-it edition, from US$ 155 a year. Validated against NIST Standard Reference Datasets.