Unformatted text preview: X n ) is recurrent. (c) Assuming recurrence, ﬁnd the relation between the Pinvariant measure and the Qinvariant measure. (d) Deduce that, on an inﬁnite state space, it is possible for ( Y n ) to be positiverecurrent while ( X n ) is not. 5. Let X n be an ﬁnite irreducible chain with transition matrix P . Fix a subset A of S . Deﬁne a transition matrix Q on A by q ( i,j ) = p ( i,j ) / X k ∈ A p ( i,k ) . Suppose Q is irreducible. In the case where P is reversible , ﬁnd a simple explicit formula for the stationary distribution π * of Q in terms of P and its stationary distribution π . Give an example to show that the formula may not hold in the nonreversible case. 2...
View
Full
Document
 Spring '09
 Reed
 Sets

Click to edit the document details