This preview shows pages 1–2. Sign up to view the full content.
This preview has intentionally blurred sections. Sign up to view the full version.
View Full Document
Unformatted text preview: ORIE 3510 Homework 5 Solutions Instructor: Mark E. Lewis due 2PM, Wednesday February 29, 2012 (ORIE Hallway drop box) 1. The chain is irreducible. Since p (4 n +6 m ) 1 , 1 > 0, n,m N , the period of state 1 is d (1) = 2. By solidarity property, d (8) = 2. 2. Counterexample. Consider a Markov chain { X n ,n } with transition matrix given by P = parenleftbigg 0 1 1 0 parenrightbigg . The period of this Markov chain is 2. But { X 2 n ,n } is not irreducible since P 2 n = parenleftbigg 1 0 0 1 parenrightbigg . 3. (a) Solving the steady state equations ( 1 , 2 , 3 ) = ( 1 , 2 , 3 ) 1 / 3 2 / 3 1 / 3 2 / 3 1 , together with 1 + 2 + 3 = 1, we obtain ( 1 , 2 , 3 ) = ( 9 20 , 3 20 , 8 20 ) . Hence the required proportion is given by 3 = 8 / 20. (b) the long run earning = 10 9 20 + 30 3 20 + 50 8 20 = $29 . 4. If suffices to check that summationdisplay k X summationdisplay l X ( k,l ) q ( k,l ) , ( i,j ) = ( i,j...
View
Full
Document
 Spring '09
 RESNIK

Click to edit the document details