E the markov chain is irreducible and hence all the

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: ecurrent. Moreover, state 0 is aperiodic as 21 0, 1 0 and 0 for 6 . Therefore all the states are aperiodic and hence the Markov chain is ergodic. Thus the limiting probabilies are given by the unique solution of 1 1 1 1 1 and 1 Since 0.2 satisfies the above equations and limiting probabilities must be unique, the limiting probabilities of all the five states must be 0.2. c) What is the expected number of steps the particle takes to return to the starting position? 1 5 Page 5 of 5...
View Full Document

{[ snackBarMessage ]}

Ask a homework question - tutors are online