Chapter24_TAMU.pdf - ECEN 489 Information Theory Inference and Learning Algorithms Chapter 24 Exact Marginalization Dr Chao TIAN Texas A&M University 1

# Chapter24_TAMU.pdf - ECEN 489 Information Theory Inference...

• 17

This preview shows page 1 - 6 out of 17 pages.

ECEN 489: Information Theory, Inference, and Learning Algorithms Chapter 24: Exact Marginalization Dr. Chao TIAN Texas A&M University 1 / 14 Inferring the Mean and the Variance of a Gaussian The one dimensional Gaussian distribution: P ( x | μ, σ ) = 1 2 πσ exp - ( x - μ ) 2 2 σ 2 , Normal( x ; μ, σ 2 ) . Given the model, but unknown parameters μ, σ 2 ; Prior distribution on μ, σ 2 : I No prior knowledge: uniform distribution over the ranges; I More convenient choices: conjugate priors. 2 / 14 FYI: What are the Conjugate Priors for μ and σ ? Conjugate prior: When the posterior distributions P ( θ | x ) are in the same family as the prior probability distribution P ( θ ). For the mean μ of a Gaussian: a Gaussian distribution Normal( μ ; μ 0 , σ 2 μ ) For the standard deviation σ of a Gaussian: a Gamma distribution P ( β ) = Γ( β ; b β , c β ) = 1 Γ( c β ) β c β - 1 b c β β exp - β b β , 0 β ≤ ∞ . where β = 1 2 and Γ( x ) , R 0 u x - 1 e - u du . 3 / 14 FYI: What are the Conjugate Priors for μ and σ ? Conjugate prior: When the posterior distributions P ( θ | x ) are in the same family as the prior probability distribution P ( θ ). For the mean μ of a Gaussian: a Gaussian distribution Normal( μ ; μ 0 , σ 2 μ ) For the standard deviation σ of a Gaussian: a Gamma distribution P ( β ) = Γ( β ; b β , c β ) = 1 Γ( c β ) β c β - 1 b c β β exp - β b β , 0 β ≤ ∞ . where β = 1 2 and Γ( x ) , R 0 u x - 1 e - u du . 3 / 14 FYI: What are the Conjugate Priors for μ and σ ? Conjugate prior: When the posterior distributions P ( θ | x ) are in the same family as the prior probability distribution P ( θ ).  #### You've reached the end of your free preview.

Want to read all 17 pages?

• Spring '14

### What students are saying

• As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

Kiran Temple University Fox School of Business ‘17, Course Hero Intern

• I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

Dana University of Pennsylvania ‘17, Course Hero Intern

• The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

Jill Tulane University ‘16, Course Hero Intern  