This preview shows page 1. Sign up to view the full content.
Unformatted text preview: E i T i = 1 / ( i ). (c) Use (a) to prove E i ( T i ) 2 = 2 E i T i ( X j ( E j T i /E j T j )1) . 5. Let ( X n ; n 0) be a nitestate irreducible Markov chain. Write for the stationary distribution and T j = min { n 0 : X n = j } for the rst hitting time. (a) Prove that j j E i T j does not depend on i . (b) Give an example to show that i i E i T j may depend on j . 5...
View
Full
Document
 Spring '09
 Reed

Click to edit the document details