This preview shows page 1. Sign up to view the full content.
Unformatted text preview: ecurrent. Moreover, state 0 is aperiodic as
6 . Therefore
all the states are aperiodic and hence the Markov chain is ergodic. Thus the limiting
probabilies are given by the unique solution of
0.2 satisfies the above equations and limiting
probabilities must be unique, the limiting probabilities of all the five states must be
c) What is the expected number of steps the particle takes to return to the starting
5 Page 5 of 5...
View Full Document