X e x x e xx x x e xx e x e x e xx e xx where the

This preview shows page 71 - 79 out of 107 pages.

X E  X  X  E XX X X  E XX E X E X  E XX    E XX  where the last expression can be useful as a computational device. 71
Image of page 71

Subscribe to view the full document.

Sometimes we need to use the variance matrix of a row vector. Naturally, we will arrange the variances and covariances in the same way as when X is a column vector. For computation, it is easiest to just note that if X is a row vector then we define Var X Var X . For now, we take X to be a column vector. 72
Image of page 72
Why does it make sense to define Var X as we have? Consider linear combinations of X that are random variables. Let a be an m 1 vector and let Y a X a 1 X 1 ... a m X m . Then we already know that Y E Y a E X a X j 1 m a j j . 73
Image of page 73

Subscribe to view the full document.

Now we can compute Var Y : Var Y E  Y Y 2 E  a X a X 2 E  a X X  2 E  a X X  a X X  E a X X  X X a a E  X X  X X a a Var X a . 74
Image of page 74
So we have shown that, given the definition of Var X , Var a X a Var X a We can write this out using summations as Var j 1 m a j X j j 1 m a j 2 j 2 2 i 1 m 1 j i 1 m a i a j ij With a 1,1,...,1 , Var j 1 m X j j 1 m j 2 2 i 1 m 1 j i 1 m ij 75
Image of page 75

Subscribe to view the full document.

If we have two RVs X and Y , Var aX bY a 2 Var X b 2 Var Y 2 abCov X , Y Var X Y Var X Var Y 2 Cov X , Y Var X Y Var X Var Y 2 Cov X , Y If X and Y are uncorrelated, Var X Y Var X Y X 2 Y 2 76
Image of page 76