This preview shows pages 1–13. Sign up to view the full content.
This preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full DocumentThis preview has intentionally blurred sections. Sign up to view the full version.
View Full Document
Unformatted text preview: Statistical Data Mining ORIE 474 Spring 2007 Tatiyana Apanasovich 09/26/07 Review: SLR Simple Linear Regression Least Squares Estimation The case of simple linear regression considers a single regressor or predictor x and a dependent or response variable Y . The observation of Y at each level of x is a random variable with mean: We assume that each observation, Y , can be described by the model x x X Y E 1 ) ( + = = Simple Linear Regression Least Squares Estimation Suppose that we have n pairs of observations( x 1 , y 1 ), ( x 2 , y 2 ), , ( x n , y n ). Simple Linear Regression Least Squares Estimation Assumptions: 1. The model can be written as 2. Xs are nonstochastic (fixed, or measured without error) 3. are iid , therefore are independently distributed as 4. X and are uncorrelated. i i i x x X Y E 1 ) ( + = = 2 ) ( = i i x Y V ) , ( ~ 2 N i i i i x Y + + = 1 i Y ) , ( 2 1 i x N + Simple Linear Regression Least Squares Estimation The method of least squares is used to estimate the parameters, and 1 by minimizing the sum of the squares of the vertical deviations in Figure 66. i i x y 1 + = i.e., = n i i i y y 1 2 ) ( Simple Linear Regression Least Squares Estimation t he n observations in the sample can be expressed as The sum of the squares of the deviations of the observations from the true regression line is Simple Linear Regression Least Squares Estimation Simple Linear Regression Least Squares Estimation Simple Linear Regression Least Squares Estimation can be treated as an estimate of i e i 1 = = n i i e Simple Linear Regression Least Squares Estimation Notation Simple Linear Regression Least Squares Estimation Simple Linear Regression...
View
Full
Document
This note was uploaded on 12/23/2009 for the course ORIE 474 at Cornell University (Engineering School).
 '07
 APANASOVICH

Click to edit the document details