{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

Hw5-ORIE3510_S12

# Hw5-ORIE3510_S12 - ORIE 3510 Homework 5 Instructor Mark E...

This preview shows pages 1–2. Sign up to view the full content.

ORIE 3510 – Homework5 Instructor: Mark E. Lewis due 2PM, Wednesday February 29, 2012 (ORIE Hallway drop box) 1. Consider a Markov chain on the states { 1 , 2 , . . . , 9 } with transition matrix 0 . 5 0 0 . 5 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 (a) Is this chain irreducible? (b) Find the period of state 1 and state 8. 2. If { X n , n 0 } is an irreducible Markov chain with period d 2. Is { X dn , n 0 } irreducible? Justify your statement by proof (for YES) or by a counterexample (for NO). 3. Harry plays semipro basketball where he is a defensive specialist. His scoring productivity per game fluctuates between three states: 1 (scores 0 or 1 points), 2 (scores between 2 and 5 points), 3 (scores more than 5 points). Inevitably, if Harry scores a lot of points in one game, his jealous teammates refuses to pass him the ball in the next game, so his productivity in the next game will be nil. These transitions could be modeled by a Markov chain with transition matrix P =

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

### Page1 / 2

Hw5-ORIE3510_S12 - ORIE 3510 Homework 5 Instructor Mark E...

This preview shows document pages 1 - 2. Sign up to view the full document.

View Full Document
Ask a homework question - tutors are online