This preview shows pages 1–3. Sign up to view the full content.
This preview has intentionally blurred sections. Sign up to view the full version.
View Full Document
Unformatted text preview: 16 mcsftl 2010/9/8 0:40 page 431 #437 Independence 16.1 Definitions Suppose that we ip two fair coins simultaneously on opposite sides of a room. Intuitively, the way one coin lands does not affect the way the other coin lands. The mathematical concept that captures this intuition is called independence : Definition 16.1.1. Events A and B are independent if Pr B D or if Pr A j B D Pr A : (16.1) In other words, A and B are independent if knowing that B happens does not al ter the probability that A happens, as is the case with ipping two coins on opposite sides of a room. 16.1.1 Potential Pitfall Students sometimes get the idea that disjoint events are independent. The opposite is true: if A \ B ; , then knowing that A happens means you know that B D does not happen. So disjoint events are never independentunless one of them has probability zero. 16.1.2 Alternative Formulation Sometimes it is useful to express independence in an alternate form: Theorem 16.1.2. A and B are independent if and only if Pr A \ B D Pr A Pr B : (16.2) Proof. There are two cases to consider depending on whether or not Pr B D . Case 1 . Pr B D 0/ : If Pr B D , A and B are independent by Definition 16.1.1 . In addition, Equation 16.2 holds since both sides are 0. Hence, the theorem is true in this case. Case 2 . Pr B > 0/ : By Definition 15.1.1 , Pr A \ B D Pr A j B Pr B : 432 mcsftl 2010/9/8 0:40 page 432 #438 Chapter 16 Independence So Equation 16.2 holds if Pr A j B D Pr A ; which, by Definition 16.1.1 , is true iff A and B are independent. Hence, the theorem is true in this case as well. 16.2 Independence Is an Assumption Generally, independence is something that you assume in modeling a phenomenon. For example, consider the experiment of ipping two fair coins. Let A be the event that the first coin comes up heads, and let B be the event that the second coin is heads. If we assume that A and B are independent, then the probability that both coins come up heads is: 1 1 1 Pr A \ B D Pr A Pr B D 2 2 D 4 : In this example, the assumption of independence is reasonable. The result of one coin toss should have negligible impact on the outcome of the other coin toss. And if we were to repeat the experiment many times, we would be likely to have A \ B about 1/4 of the time. There are, of course, many examples of events where assuming independence is not justified, For example, let C be the event that tomorrow is cloudy and R be the event that tomorrow is rainy. Perhaps Pr C D 1=5 and Pr R D 1=10 in Boston. If these events were independent, then we could conclude that the probability of a rainy, cloudy day was quite small: 1 1 1 Pr R \ C D Pr R Pr C D D : 5 10 50 Unfortunately, these events are definitely not independent; in particular, every rainy day is cloudy. Thus, the probability of a rainy, cloudy day is actually 1=10 ....
View
Full
Document
This note was uploaded on 01/19/2012 for the course CS 6.042J / 1 taught by Professor Tomleighton,dr.martenvandijk during the Fall '10 term at MIT.
 Fall '10
 TomLeighton,Dr.MartenvanDijk
 Computer Science, The Land

Click to edit the document details