# note 10 - MA2216/ST2131 Probability Notes 10 Properties of...

This preview shows pages 1–4. Sign up to view the full content.

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: MA2216/ST2131 Probability Notes 10 Properties of Expectation and Inequalities Â§ 1. Summary of Basic Properties. Let us first review some elementary properties of mathematical expec- tation, and then develop and exploit additional properties and useful calculations. (Recall that mathematical expectation had been defined in Â§ 4 of Notes 3 in a not-quite rigorous way.) 1. To begin with, take note that the expected value of a discrete r.v. X can be defined if X x | x | f X ( x ) < âˆž , i.e., the series X x | x | f X ( x ) converges. In such a case, the expected value (or mean) Î¼ X of X is given by Î¼ X = EE [ X ] = X x xf X ( x ) . Analytically speaking , the series X x xf X ( x ) has to converge abso- lutely , i.e., X x | x | f X ( x ) < âˆž , so that the expected value of X may be defined. For a continuous r.v. X , its expected value exists if Z IR | x | f X ( x ) dx < âˆž , and in such a case, Î¼ X = EE [ X ] = Z IR xf X ( x ) dx. In short, EE [ X ] exists if EE [ | X | ] < âˆž . In a similar fashion, we say EE [ g ( X )] is defined if EE [ | g ( X ) | ] < âˆž . 1 2. The above is the univariate case. For the multivariate case, (a) If X and Y are jointly discrete with joint p.d.f. f X,Y , then EE [ g ( X,Y )] = X x X y g ( x,y ) f X,Y ( x,y ) , provided that X x X y | g ( x,y ) | f X,Y ( x,y ) < âˆž . (b) If X and Y are jointly continuous with joint p.d.f. f X,Y , then EE [ g ( X,Y )] = Z âˆž-âˆž Z âˆž-âˆž g ( x,y ) f X,Y ( x,y ) dxdy, provided that Z âˆž-âˆž Z âˆž-âˆž | g ( x,y ) | f X,Y ( x,y ) dxdy < âˆž . 3. Note. Not every r.v. has finite mean. We give two examples for refer- ence. (a) Consider a positive integer-valued r.v. X having p.d.f. f X given by f X ( k ) = 1 k ( k + 1) , k = 1 , 2 ,... (This is a genuine probability density function, for it is non-negative everywhere and its total sum over positive integers is 1.) But, âˆž X k =1 k f X ( k ) = âˆž X k =1 1 k + 1 = âˆž , and hence X does not have finite mean, (or its mean is not defined). (b) Let X have the p.d.f. f given by f ( x ) = 1 Ï€ (1 + x 2 ) ,-âˆž < x < âˆž . (This is also known as a Cauchy distribution.) Then, X does not have finite expectation. For Z âˆž-âˆž | x | 1 Ï€ (1 + x 2 ) dx = 2 Ï€ Z âˆž x 1 + x 2 dx = 2 Ï€ lim c â†’âˆž Z c x 1 + x 2 dx = 1 Ï€ lim c â†’âˆž log (1 + x 2 ) fl fl c = âˆž . 2 Next, some basic properties of expectation. 4. Linearity. If EE | X i | < âˆž for i = 1 , 2 , Â·Â·Â· ,n , then EE Ë† n X i =1 X i ! = n X i =1 EEX i . More generally, for r.v.â€™s X 1 ,X 2 ,...,X n with finite means, we have EE " n X k =1 Î± k X k + Î² # = n X k =1 Î± k EE [ X k ] + Î², where Î± k â€™s and Î² are constants. For the multivariate case, EE [ g ( X,Y ) + h ( X,Y )] = EE [ g ( X,Y )] + EE [ h ( X,Y )] ....
View Full Document

{[ snackBarMessage ]}

### Page1 / 28

note 10 - MA2216/ST2131 Probability Notes 10 Properties of...

This preview shows document pages 1 - 4. Sign up to view the full document.

View Full Document
Ask a homework question - tutors are online