A particle moves on a circle through points which

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: have been marked 0,1,2,3,4 (in a clockwise order). At each step, it has a probability of moving to the right (clockwise) denote its location on the circle after the and 1 to the left (counterclockwise). Let step. The process , 0 is a Markov chain. a) Find the transition probability matrix. 0 0 1 0 0 0 0 0 1 0 0 0 1 1 0 0 0 0 1 0 b) Determine the limiting probabilities. Assume non-trivial case 0 1. Obviously all the states communicate with each other, i.e. the Markov chain is irreducible and hence all the states are r...
View Full Document

This note was uploaded on 03/15/2014 for the course STAT 2303 taught by Professor Steven during the Fall '11 term at HKU.

Ask a homework question - tutors are online