This preview shows pages 1–3. Sign up to view the full content.
This preview has intentionally blurred sections. Sign up to view the full version.
View Full Document
Unformatted text preview: IEOR 4106, Spring 2011, Professor Whitt Topics for Discussion: Tuesday, April 12 Renewal Theory: Patterns 1. Patterns: see 3.6.4 and 7.9 Consider successive independent flips of a biased coin. On each flip, the coin comes up heads (H) with probability p or tails (T) with probability q = 1 p , where 0 < p < 1. A given segment of finitely many consecutive outcomes is called a pattern . The pattern is said to occur at flip n if the pattern is completed at flip n . For example, the pattern A HTHTHT occurs at flips 8 and 10 in the sequence TTHTHTHTHTTTTHHHT ... and at no other times among the first 17 flips. WARMUP For parts (a) and (b) below, assume that p = 1 / 2, but for later parts do not make that assumption. (a) Which pattern occurs more frequently in the long run: A HHH or B HTH ? (b) For patterns A and B in part (a), let N A and N B be the numbers of flips until the patterns A and B , respectively, first occur. Is E [ N A ] = E [ N B ]? MAIN PROBLEM Now we revert to general probabilities p and q = 1 p . (c) What is the probability that pattern A HTHTHT occurs at flip 72? (d) Suppose that pattern A from part (c) does indeed occur at flip 72. What is the expected number of flips until pattern A occurs again? (e) Let N A ( n ) be the number of occurrences of pattern A in the first n flips, where A is again the pattern in part (c). Does N A ( n ) n x as n w.p.1? If so, what is the limit x ? (f) What is E [ N A ], the expected number of flips until pattern A HTHTHT first occurs? (g) What is the probability that pattern A occurs before pattern B TTH ? That is, what is P ( N A < N B )? NOTATION (i) A or B , a possible pattern, as in parts (a) and (c) above (ii) N A , a random variable, equal to the number of flips until the pattern A occurs for the first time, as defined in part (b) above (iii) A ( n ), the event that pattern A occurs (ends) on flip n . Note that in part (c), we are asking for the value of P ( A (72)). (iv) T A , a random variable, equal to the number of flips until the pattern A occurs again, after it has occurred previously. This formalized the question in part (d). (v) N A ( n ), a random variable, equal to the number of times that pattern A occurs in the first n flips, as defined above in part (e) (vi) N A B , a random variable, equal to the number of flips until the pattern B first occurs starting from the occurrence of A . This is new notation used to derive the answers to parts....
View
Full
Document
This note was uploaded on 01/16/2012 for the course IEOR 4106 taught by Professor Whitward during the Spring '11 term at Columbia College.
 Spring '11
 WhitWard

Click to edit the document details