{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

Hw4-ORIE3510_S12_solns

# Hw4-ORIE3510_S12_solns - ORIE 3510 Homework 4 Solutions...

This preview shows pages 1–3. Sign up to view the full content.

ORIE 3510 – Homework 4 Solutions Instructor: Mark E. Lewis due 2PM, Wednesday February 22, 2012 (ORIE Hallway drop box) 1. If p ij were (strictly) positive, then p ( n ) ji would be 0 for all n (otherwise, i and j would communicate). But then the process, starting in i , has a positive probability of at least p ij of never returning to i . This contradicts the recurrence of i . Hence p ij = 0. 2. a) The classes are { 1 , 2 , 6 , 9 } , { 3 , 4 , 7 } and { 5 , 8 } b) { 1 , 2 , 6 , 9 } and { 3 , 4 , 7 } are recurrent. { 5 , 8 } is transient. 1/2 1/2 3 1 1/2 1 2 7 1 4 1 1 2/3 3/4 1/2 6 9 8 1 1/3 5 1/4 c) Let d ( i ) denote the period of state i . We have that d (1) = d (2) = d (6) = d (9) = 4 d (3) = d (4) = d (7) = 1 d (5) = d (8) = 2 3. If M i =0 p ij = 1 for all i , then π j = 1 / ( M + 1) satisfies π j = M X i =0 π i p ij and M X j =0 π j = 1 . 1

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Since the chain is irreducible and aperiodic, there is a unique nonnegative solution to the steady state equation. That is, π j given as above is the limiting probabilities and π is the limiting distribution.
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

### What students are saying

• As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

Kiran Temple University Fox School of Business ‘17, Course Hero Intern

• I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

Dana University of Pennsylvania ‘17, Course Hero Intern

• The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

Jill Tulane University ‘16, Course Hero Intern