This preview shows pages 1–3. Sign up to view the full content.
This preview has intentionally blurred sections. Sign up to view the full version.
View Full Document
Unformatted text preview: 1 Ordinary LeastSquares Ordinary LeastSquares Ordinary LeastSquares Outline Linear regression Geometry of leastsquares Discussion of the GaussMarkov theorem Ordinary LeastSquares Onedimensional regression a b Ordinary LeastSquares Onedimensional regression ax b = Find a line that represent the best linear relationship: a b Ordinary LeastSquares Onedimensional regression x a b e i i i = Problem: the data does not go through a line x a b i i a b Ordinary LeastSquares Onedimensional regression x a b e i i i = Problem: the data does not go through a line Find the line that minimizes the sum: 2 ) (  i i i x a b x a b i i a b 2 Ordinary LeastSquares Onedimensional regression x x a b e i i i = 2 ) ( ) (  = i i i x a b x e Problem: the data does not go through a line Find the line that minimizes the sum: We are looking for that minimizes 2 ) (  i i i x a b x a b i i a b Ordinary LeastSquares Matrix notation Using the following notations and = n a a : 1 a = n b b : 1 b Ordinary LeastSquares Matrix notation Using the following notations and we can rewrite the error function using linear algebra as: = n a a : 1 a = n b b : 1 b 2 2 ) ( ) ( ) ( ) ( ) ( a b a b a b x x e x x x a b x e T i i i = = = Ordinary LeastSquares Matrix notation Using the following notations and we can rewrite the error function using linear algebra as: = n a a : 1 a = n b b : 1 b 2 2 ) ( ) ( ) ( ) ( ) ( a b a b a b x x e x x x a b x e T i i i = = = Ordinary LeastSquares Multidimentional linear regression Using a model with m parameters = + + = j j j m m x a x a x a b ......
View
Full
Document
This note was uploaded on 08/22/2010 for the course CAP 6701 taught by Professor Staff during the Spring '10 term at University of Central Florida.
 Spring '10
 Staff

Click to edit the document details