0 t i which implies ii q 1 q i cs 522 v 094

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: 1 + ::::: + q i CS 522, v 0.94, d.medhi, W’99 ik ii + ::::: + q ik + ::: = 0: 7 X qij + qii = 0: In short, we have j =i 3 6 Typically, we denote qii = ,qi , thus, we have X qij = qi: j =i 6 The matrix, Q, is known as the transition density matrix, or, infinitesimal generator, or a rate matrix. If the state space S is finite, then 0 ,q0 q01 ::: q0m 1 Q = B q10 ,q1 ::: q1m C : @ A ::: qm0 qm1 ::: ,qm This is another way to write the C-K equation in terms of rate: P t = dP t = QP t: dt 4 dP t = P tQ: or, dt Now, consider the vector  t := f0 t 1t :::g: This is the probability vector of the state of the system at time t, i.e., probability of being at state 0 in time t is 0 t etc. 0 t! Now, we move to the steady-state situation, i.e, what is the system going to be like in steady-state as 1. It is easy to see that  t = 0P t: Also, dt =  0P t =  0P tQ = tQ: dt If we denote the steady-state probability vector by  , i.e. 0 5  = tlim t !1 then, from the relation (5)...
View Full Document

This document was uploaded on 03/19/2014 for the course CS 6030 at Western Michigan.

Ask a homework question - tutors are online