Sol_ps4_all - PS4 SOLUTIONS JEREMIE COHEN-SETTON ELIRA KARAJA 1 Demonstrate that =(X X)1 X y is such that it minimizes the SSR Given y = X and y = X e

# Sol_ps4_all - PS4 SOLUTIONS JEREMIE COHEN-SETTON ELIRA...

• Homework Help
• 4
• 100% (7) 7 out of 7 people found this document helpful

This preview shows page 1 - 2 out of 4 pages.

PS4 SOLUTIONS J ´ ER ´ EMIE COHEN-SETTON, ELIRA KARAJA 1. Demonstrate that ˆ β = ( X 0 X ) - 1 X 0 y ˆ β is such that it minimizes the SSR . Given y = + , and y = X ˆ β + e , we have SSR = e 0 e . e 0 e = ( y - X ˆ β ) 0 ( y - X ˆ β ) [by definition] = ( y 0 - ˆ β 0 X 0 )( y - X ˆ β ) [by ( A + B ) 0 = A 0 + B 0 and ( AB ) 0 = B 0 A 0 ] = y 0 y - y 0 X ˆ β - ˆ β 0 X 0 y + ˆ β 0 X 0 X ˆ β [by distribution] = y 0 y - 2 ˆ β 0 X 0 y + ˆ β 0 X 0 X ˆ β because y 0 X ˆ β = ˆ β 0 X 0 y since these are 1 × 1 matrices, i.e scalars Since we look for a minimum we take FOC of this expression with respect to ˆ β 0 . d ( e 0 e ) d ˆ β 0 = 0 - 2 X 0 y + 2 X 0 X ˆ β = 0 [by definition of derivative of a matrix] X 0 y = X 0 X ˆ β ( X 0 X ) - 1 X 0 y = ( X 0 X ) - 1 X 0 X ˆ β [Assuming ( X 0 X ) - 1 exists] ( X 0 X ) - 1 X 0 y = I K ˆ β [by definition of the inverse of a matrix] ( X 0 X ) - 1 X 0 y = ˆ β [by I K v = v for any K × 1 vector v ] 2. Demonstrate that R 2 = β 0 X 0 y 0 y (or that R 2 = ˆ β 0 X 0 X ˆ β y 0 y ) We can proceed in two ways. If we choose to use the theoretical decomposition of y (i.e y = + or what the book calls the PRF), we will have to use the assumption that E ( X 0 ) = 0. If we use the empirical decomposition of y (i.e. y = X ˆ β + e or what the book calls the SRF) we will use the algebraic result that we get from the normal equations: X 0 e = 0.

#### You've reached the end of your free preview.

Want to read all 4 pages?

### What students are saying

• As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

Kiran Temple University Fox School of Business ‘17, Course Hero Intern

• I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

Dana University of Pennsylvania ‘17, Course Hero Intern

• The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

Jill Tulane University ‘16, Course Hero Intern