final09sol - STAT455/855 Fall 2009 Applied Stochastic...

Info iconThis preview shows pages 1–3. Sign up to view the full content.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: STAT455/855 Fall 2009 Applied Stochastic Processes Final Exam, Solutions 1. (15 marks) (a) 3 marks) True . Take the simple random walk with p 6 = 1 / 2. (b) (3 marks) True . If state k were recurrent then the vector ( k ) = ( i ( k )) i S , where i ( k ) is the mean number of visits to state i during a sojourn from k back to k , satisfies ( k ) = ( k ) P . (c) (3 marks) False . Take S to be the integers and for each i S suppose that p i,i +1 > 0, p i,i- 1 > 0, p i,i +2 > 0, and p i,i- 2 > 0. Then from state i one can make the transitions i i +1 i so that p ii (2) > 0. One can also make the transitions i i + 2 i + 1 i so that p ii (3) > 0. Since the greatest common divisor of 2 and 3 is 1, the period must be 1. (d) (3 marks) False . Take S to be the integers and for each i S suppose that p ii = r , where 0 < r < 1, p i,i +1 = (1- r ) / 2, and p i,i- 1 = (1- r ) / 2. If a stationary distribution existed then this chain is time reversible because for any states i and j and any path from i to j , the reverse path will have the same probability. So the stationary distribution must satisfy the local balance equations, which are i 1- r 2 = i- 1 1- r 2 for all i . These reduce to i = i- 1 for all i . Thus, all components of must be the same. But this is impossible since S is infinite. (e) (3 marks) False . Take the simple, symmetric random walk ( p = 1 / 2), or the counterexample from part(d), where P is symmetric but no stationary distribution exists. (f) (2 bonus marks) True . If X were time reversible with stationary distribution and P were symmetric then the local balance equations i p ij = j p ji would reduce to i = j for all i, j S , since p ij = p ji . That is, all components of would have to be equal, which is impossible if S is infinite. STAT 455/855 -- Final Exam Solutions, 2009 Page 2 of 7 2. (15 marks) We check the local balance equations for all parts. (a) (5 marks) The local balance equations are i n 2- 1 = j n 2- 1 for all i, j such that j is equal to i except with two components interchanged. Thus, we get i = j for all i, j S . Since S has n ! elements, we get i = 1 n !...
View Full Document

This note was uploaded on 09/15/2010 for the course STAT 455/855 taught by Professor Glentakahara during the Fall '09 term at Queens University.

Page1 / 7

final09sol - STAT455/855 Fall 2009 Applied Stochastic...

This preview shows document pages 1 - 3. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online