{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

hw4 - solutions

# hw4 - solutions - IE 336 Operations Research Stochastic...

This preview shows pages 1–3. Sign up to view the full content.

IE 336: Operations Research - Stochastic Models Homework Set #4 Solutions Spring 2008 1. Let P= p q 0 3 q 0 r + q 0 0 1 be the transition matrix of a Markov chain (a) Determine transition diagram: 1 2 3 1 3q p q r+q (b) If q > p 2 , is it possible that p = 2 3 ? Explain It is impossible that p = 2 3 . Let assume that p = 2 3 , then q > ( 2 3 ) 2 = 4 9 . p + q > 2 3 + 4 9 = 10 9 (*) But P is a transition matrix p + q = 1 (**) Then (*) and (**) p must be different from 2 3 (c) If r = 1 5 , determine the values of p and q P is a transition matrix braceleftbigg p + q = 1 4 q + r = 1 Then q = 1 5 and p = 4 5 2. Consider the ”eye color” example from class (section 2.21 in the book). Show that transition matrix P = aa ab bb aa p 1 - p 0 ab p 2 1 2 1 - p 2 bb 0 p 1 - p For the first row of the transition matrix P { X 1 = aa | X 0 = aa } = P { X 1 = aa | X 0 = aa,father = aa } P { father = aa } + P { X 1 = aa | X 0 = aa,father = ab } P { father = ab } + P { X 1 = aa | X 0 = aa,father = bb } P { father = bb } 1

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Since P { X 1 = aa | X 0 = aa,father = aa } = 1, P { X 1 = aa | X 0 = aa,father = ab } = 1 2 , P { X 1 = aa | X 0 = aa,father = bb } = 0, P { father = aa } = p 2 , P { father = ab } = 2 p (1 - p ) P { X 1 = aa | X 0 = aa } = p Clearly, P { X 1 = bb | X 0 = aa } = 0 P { X 1 = aa | X 0 = aa } + P { X 1 = ab | X 0 = aa } = 1 P { X 1 = ab | X 0 = aa } = 1 - p For the second row of the transition matrix P { X 1 = aa | X 0 = ab } = P { X 1 = aa | X 0 = ab,father = aa } P { father = aa } + P { X 1 = aa | X 0 = ab,father = ab } P { father = ab } + P { X 1 = aa | X 0 = ab,father = bb } P { father = bb } Since P { X 1 = aa | X 0 = ab,father = aa } = 1 2 , P { X 1 = aa | X 0 = ab,father = ab } = 1 4 , P { X 1 = aa | X 0 = ab,father = bb } = 0, P { father = aa } = p 2 , P { father = ab } = 2 p (1 - p ) P { X 1 = aa | X 0 = ab } = 1 2 p 2 + 1 4 (2 p (1 - p )) = p 2 P { X 1 = ab | X 0 = ab } = P { X 1 = ab | X 0 = ab,father = aa } P { father = aa } + P { X 1 = ab | X 0 = ab,father = ab } P { father = ab } + P { X 1 = ab | X 0 = ab,father = bb } P { father = bb } Since P { X 1 = ab | X 0 = ab,father = aa } = 1 2 , P { X 1 = ab | X 0 = ab,father = ab } = 1 2 , P { X 1 =
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

### What students are saying

• As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

Kiran Temple University Fox School of Business ‘17, Course Hero Intern

• I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

Dana University of Pennsylvania ‘17, Course Hero Intern

• The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

Jill Tulane University ‘16, Course Hero Intern