{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

# lec1 - STAT 8260 Theory of Linear Models Lecture Notes...

This preview shows pages 1–3. Sign up to view the full content.

STAT 8260 — Theory of Linear Models Lecture Notes Classical linear models are at the core of the field of statistics, and are probably the most commonly used set of statistical techniques in practice. For these reasons a large portion of your coursework is devoted to them. The two main subclasses of the classical linear model are (1) linear regression models, and (2) analysis of variance (ANOVA) models. These classes of models are covered from a very applied perspective in the courses STAT 6320 (or STAT 6230) and STAT 8200, respectively. A third subclass, (3) analysis of covariance models (ANCOVA) models, combines elements of regression and ANOVA, and this subclass usually receives some treatment in STAT 6320. Because these models are such important practical tools for data analysis, instruction in the practical aspects of their application is a crucial part of your training as statisticians. It is important to realize, however, that these methods are not a collection of unrelated, specialized techniques. A general theory of estimation and inference in the linear model is available that subsumes the methods of regression, ANOVA, and ANCOVA. This theory is worth studying because it unifies and yields insight into the methods used in many, many important subcases of the linear model; and because its ideas point the way and, in some cases, carry over directly to more general (not-necessarily-linear) modelling of data. In summary, this is a theory course, and as such it is not a complete course in linear models. Very important practical aspects of these models will be omitted; they are covered elsewhere in your course-work. 1

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Introduction to Linear Models Linear models are parametric statistical models that summarize how the probability distribution of a response variable (usually denoted as Y ) depends upon one or more explanatory variables (usually denoted with X ’s: X 0 , X 1 , X 2 , . . . , X k ). They are statistical (or probabilistic) because they specify a (con- ditional) probability distribution of a random variable (or at least some aspects of that distribution, like its mean and variance). They are parametric because the probability distribution is specified up to a finite number of unknown constants, or parameters. They are linear because the mean of the conditional probability dis- tribution of Y , E( Y | X 0 , X 1 , . . . , X k ), is specified to be a linear func- tion of model parameters. This conditional mean, E( Y | X 0 , X 1 , . . . , X k ), is called the regression function for Y on X 0 , . . . , X k . The classical linear model specifies that Y = X 0 β 0 + X 1 β 1 + · · · X k β k + e = x T β + e where x = X 0 . . . X k ( k +1) × 1 , β = β 0 . . . β k ( k +1) × 1 , where e has conditional mean 0, and variance σ 2 . Notice that this model implies that the regression function is linear in the β ’s: E( Y | x ) = X 0 β 0 + X 1 β 1 + · · · X k β k .
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

### What students are saying

• As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

Kiran Temple University Fox School of Business ‘17, Course Hero Intern

• I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

Dana University of Pennsylvania ‘17, Course Hero Intern

• The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

Jill Tulane University ‘16, Course Hero Intern