{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

prml-slides-2

# prml-slides-2 - PATTERN RECOGNITION AND MACHINE LEARNING...

This preview shows pages 1–35. Sign up to view the full content.

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Parametric Distributions Basic building blocks: Need to determine given Representation: or ? Recall Curve Fitting
Binary Variables (1) Coin flipping: heads=1, tails=0 Bernoulli Distribution

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Binary Variables (2) N coin flips: Binomial Distribution
Binomial Distribution

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Parameter Estimation (1) ML for Bernoulli Given:
Parameter Estimation (2) Example: Prediction: all future tosses will land heads up Overfitting to D

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Beta Distribution Distribution over .
Bayesian Bernoulli The Beta distribution provides the conjugate prior for the Bernoulli distribution.

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Beta Distribution
Prior ∙ Likelihood = Posterior

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Properties of the Posterior As the size of the data set, N , increase
Prediction under the Posterior What is the probability that the next coin toss will land heads up?

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Multinomial Variables 1 -of- K coding scheme:
ML Parameter estimation Given: Ensure , use a Lagrange multiplier, ¸ .

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
The Multinomial Distribution
The Dirichlet Distribution Conjugate prior for the multinomial distribution.

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document