Chapter 3
Multiple regression analysis
Overview
This chapter introduces regression models with more than one explanatory variable.
Specific topics are treated
with reference to a model with just two explanatory variables, but most of the concepts and results apply
straightforwardly to more general models.
The chapter begins by showing how the least squares principle is
employed to derive the expressions for the regression coefficients and how the coefficients should be interpreted.
It continues with a discussion of the precision of the regression coefficients and tests of hypotheses relating to
them.
Next comes multicollinearity, the problem of discriminating between the effects of individual explanatory
variables when they are closely related.
The chapter concludes with a discussion of
F
tests of the joint
explanatory power of the explanatory variables or subsets of them, and shows how a
t
test can be thought of as a
marginal
F
test.
Learning outcomes
After working through the corresponding chapter in the text, studying the corresponding slideshows, and doing
the starred exercises in the text and the additional exercises in this guide, you should be able to explain:
the principles behind the derivation of multiple regression coefficients (but you are not expected to learn the
expressions for them or to be able to reproduce the mathematical proofs)
•
•
•
•
•
•
•
•
•
•
•
how to interpret the regression coefficients
the Frisch–Waugh–Lovell graphical representation of the relationship between the dependent variable and
one explanatory variable, controlling for the influence of the other explanatory variables
the properties of the multiple regression coefficients
what factors determine the population variance of the regression coefficients
what is meant by multicollinearity
what measures may be appropriate for alleviating multicollinearity
what is meant by a linear restriction
the
F
test of the joint explanatory power of the explanatory variables
the
F
test of the explanatory power of a group of explanatory variables
why
t
tests on the slope coefficients are equivalent to marginal
F
tests.
You should know the expression for the population variance of a slope coefficient in a multiple regression model
with two explanatory variables.
10.10.07

This
** preview**
has intentionally

**sections.**

*blurred***to view the full version.**

*Sign up*