67.

At all times, an urn contains N balls–some white balls and some black balls. At each stage, a coin having probability p, 0 < p < 1, of landing heads is flipped. If heads appears, then a ball is chosen at random from the urn and is replaced by a white ball. Let Xn denote the number of white balls in the urn after the nth stage.

(a)Is {Xn , n ≥ 0} a Markov chain? If so, explain why?

(b) What are its classes? What are their periods? Are they transient or recurrent?

(c) Compute the transition probabilities Pi,j .

(d) Let N = 2. Find the proportion of time in each state.

(e) Based on your answer in part (d) and your intuition, guess the answer for the limiting probability in the general case.

(f) Prove your guess in part (c)

(g) If p = 1, what is the expected time until there are only white balls in the urn if initially there are i white and N - i black?

At all times, an urn contains N balls–some white balls and some black balls. At each stage, a coin having probability p, 0 < p < 1, of landing heads is flipped. If heads appears, then a ball is chosen at random from the urn and is replaced by a white ball. Let Xn denote the number of white balls in the urn after the nth stage.

(a)Is {Xn , n ≥ 0} a Markov chain? If so, explain why?

(b) What are its classes? What are their periods? Are they transient or recurrent?

(c) Compute the transition probabilities Pi,j .

(d) Let N = 2. Find the proportion of time in each state.

(e) Based on your answer in part (d) and your intuition, guess the answer for the limiting probability in the general case.

(f) Prove your guess in part (c)

(g) If p = 1, what is the expected time until there are only white balls in the urn if initially there are i white and N - i black?

### Recently Asked Questions

- Sally bought her first house. The price was $200,000. She paid a down payment of 10% - $20,000. The remainder of the purchase price was paid with a bank

- Explain the Herzberg model, and give examples of each content.

- Consider a utility function: Utility=5√(income). Your income is $144, but there is an illness going around the area that costs $95 to cure. There is a 20%