Page 352 number 1.
From the state
only transitions to
possible. The rate for the former transitions is the product of the rate at which
mating occurs, namely
male offspring, namely,
times the probability that the mating prod
page 15, number 4.
page 16, number 13.
be the event you roll a on the first toss. Let
be the event that the
first roll after the first toss which is either a 7 or the same as the first toss is the
same as the first toss.
Consider the following strategy for comparing two medical treatments, say
treatment A and treatment B. Patients are treated one at a time and the result of
each treatment is recorded as a Success or a Failure. Every time a treatment
succeeds the next p
A Markov Chain has state space
and transition matrix
Identify all the communicating classes and say whether or not each is transient.
Solution: Since 2 leads only to 2 one class is
and must be in a class of its own,
. Similarly 3 leads only t
Page 579 number 2.
are independent and
the conditional distribution of
is normal with mean
; see the lecture notes.
To apply the result let
is independent of
so that conditioning on
not change the
x vs c kVs vss S u c c q
c ne i a s
TV s c a e T cs d V
cs d c
tf%S b h 'gUBfg%t'tuutf%)Dgf91'tuutf%)Dgf~UWHD%B9UugfUS P '
x T e b c c q c n e a i a T cV eVsV r S r a q d c X c T cV eVsV r S r a q d c a T e a r S T b aV
Page 234 Number 46.
Solution: To avoid confusion let
be the number of sites on the circle,
be the state visited at time
be the event
whose probability we are to calculate. Consider first the case where
Any trajectory of this kind i
page 85, number 25, page 85, number 26 and page 87, number 40.
7 games are played if, after 6 games, each team has won 3. This has probability
This is maximized when
is maximized. Take the derivative
wrt to get
which is 0 when
so this is a maximum.
Cosmic rays arrive at a particle detector according to a Poisson Process with
Compute the probability that 4 cosmic rays arrived in a time period of
starting from time
given that given that 8 cosmic
rays arrived in the time period fro
Page 226 numbers 2 and 3.
has eight states
Notice that the first two letters in state
must match the last two letters in
because they refer to the same days.
For the states in the order above:
Page 226 number 5.
Lecture 17: More on Hidden Markov Models
(Text Section 4.11)
Recall: Let Yt be the observed response at time t, and let Zt be the hidden state at time t,
t = 1, . . . , n. The process cfw_Yt follows a HMM if
1. There are K hidden states (K is assumed kno