This question has been answered by Expert on Dec 17, 2010. View Solution
posted a question
{Xn, n > 0 } is a Markov Chain, such that Xn is an element of {1, 2},

P[Xn+1 = 2 | Xn = 1] = a, which is a probability between (0,1)
P[Xn+1 = 1 | Xn = 2] = b, which is a probability between (0,1)


P[X5 = 1 | X1 = 1] = ?
Expert answered the question
Dear Student,
Please find...  View Full Answer

Download Preview:

Given that,
P(Xn+1=2|Xn=1)=a ; i.e. P(Xn+1=1|Xn=1)=1-a
P(Xn+1=1|Xn=2)=b...