{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

4714_Bayesian (not in book)

# 4714_Bayesian (not in book) - 1 STAT 4714 The Bayesian...

This preview shows pages 1–4. Sign up to view the full content.

1

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
STAT 4714 The Bayesian Approach to Estimation Introduction In the traditional approach to estimation and confidence intervals that we have been studying, an unknown population parameter is treated as fixed. For example, consider a 95% confidence interval for the unknown mean μ of a normal population with known standard deviation σ . Before the observations 1 2 , , , n X X X K are collected we can say that 1.96 1.96 .95 P X X n n σ σ μ - + = . Now suppose that we obtain the n observations and find that the confidence interval is 10.43 12.56 μ . If μ is assumed to be fixed, then the probability .95 does not apply to this particular interval. The probability that μ is in the interval [10.43,12.56] is either 0 or 1 depending on whether μ is in this interval or not. The probability .95 applies to the long run relative frequency with which intervals of the form 1.96 1.96 X X n n σ σ μ - + will include the fixed (but unknown) value of μ . It is the intervals that are assumed to be random here, not μ . If we continually repeat the process of drawing samples of n observations from the population and computing a confidence interval for each of these samples, then, in the long run, 95% of these intervals will include μ and 5% will not include μ . There is another approach to estimating unknown parameters and obtaining intervals for these parameters, called the Bayesian approach, that is based on a completely different paradigm. This approach represents prior information about an unknown parameter using a prior distribution . Once the data are obtained, Bayes Theorem is used to combine the prior distribution with the data to obtain what is called the posterior distribution for the parameter. This posterior distribution is actually proportional to the product of the likelihood function (for the fixed set of data) and the prior distribution. Once the posterior distribution is determined, it can then be used to obtain an estimate of the unknown parameter or to obtain an interval for the parameter. The prior distribution for the unknown parameter can be obtained from past information about the parameter, or can be based on subjective knowledge. In the Bayesian approach the unknown parameter is treated as a random variable, so this approach is completely different from the classical approach in which the parameter is treated as fixed. Before 2
explaining the Bayesian approach, it will be useful to review Bayes Theorem, and consider the extension of this theorem to random variables. If the events 1 2 , , , n A A A K form a partition of the sample space S , where ( ) 0 i P A , 1,2, , i n = K , and B is an event with ( ) 0 P B , then Bayes Theorem says that 1 ( | ) ( ) ( | ) ( | ) ( ) j j j n i j j P B A P A P A B P B A P A = = . If X and Y are discrete random variables, then we can apply Bayes Theorem (with B corresponding to X x = and j A corresponding to Y y = ) to get ( | ) ( ) ( | ) ( | ) ( ) y P X x Y y P Y y P Y y X x P X x Y y P Y y = = = = = = = = = .

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

### What students are saying

• As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

Kiran Temple University Fox School of Business ‘17, Course Hero Intern

• I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

Dana University of Pennsylvania ‘17, Course Hero Intern

• The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

Jill Tulane University ‘16, Course Hero Intern