Question 2 In a Markov chain model for the progression of a disease, Xn denotes the level of severity in year n, for n = 0, 1, 2, 3, .
View the step-by-step solution to:

Question

Question 2 In a Markov chain model for the progression of a disease, Xn denotes the level of severity in year n,

for n = 0, 1, 2, 3, . . .. The state space is {1, 2, 3, 4} with the following interpretations: in state 1 the symptoms are under control, state 2 represents moderate symptoms, state 3 represents severe symptoms and state 4 represents a permanent disability. The transition matrix is: P =   1 4 1 2 0 1 4 0 1 4 1 2 1 4 0 0 1 2 1 2 0 0 0 1   (a) Classify the four states as transient or recurrent giving reasons. What does this tell you about the long-run fate of someone with this disease? (b) Calculate the 2-step transition matrix. (c) Determine (i) the probability that a patient whose symptoms are moderate will be permanently disabled two years later and (ii) the probability that a patient whose symptoms are under control will have severe symptoms one year later. (d) Calculate the probability that a patient whose symptoms are moderate will have severe symptoms four years later. A new treatment becomes available but only to permanently disabled patients, all of whom receive the treatment. This has a 75% success rate in which case a patient returns to the "symptoms under control" state and is subject to the same transition probabilities as before. A patient whose treatment is unsuccessful remains in state 4 receiving a further round of treatment the following year. (e) Write out the transition matrix for this new Markov chain and classify the states as transient or recurrent. (f) Calculate the stationary distribution of the new chain. 

Recently Asked Questions

Why Join Course Hero?

Course Hero has all the homework and study help you need to succeed! We’ve got course-specific notes, study guides, and practice tests along with expert tutors.

-

Educational Resources
  • -

    Study Documents

    Find the best study resources around, tagged to your specific courses. Share your own to gain free Course Hero access.

    Browse Documents
  • -

    Question & Answers

    Get one-on-one homework help from our expert tutors—available online 24/7. Ask your own questions or browse existing Q&A threads. Satisfaction guaranteed!

    Ask a Question
Ask Expert Tutors You can ask 0 bonus questions You can ask 0 questions (0 expire soon) You can ask 0 questions (will expire )
Answers in as fast as 15 minutes