NonparametricBayes

NonparametricBayes - Nonparametric Bayesian Models...

Info iconThis preview shows pages 1–14. Sign up to view the full content.

View Full Document Right Arrow Icon
Nonparametric Bayesian Models
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
10/25/10 Parametric Model
Background image of page 2
10/25/10 Nonparametric Model
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
10/25/10 Example: k Nearest Neighbor (kNN) Classifier x x x x o x o o o o ? ? ?
Background image of page 4
10/25/10 Bayesian Nonparametric Models Model is based on an infinite dimensional parameter space But utilizes only a finite subset of available parameters on any given (finite) data set i.e., model complexity is finite but unbounded Typically § Parameter space consists of functions or measures § Complexity is limited by marginalizing out over surplus dimensions nonnegative function over sets
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
10/25/10 Content of most slides borrowed from
Background image of page 6
10/25/10 What Will This Buy Us? Distributions over § Partitions E.g., for inferring topics when number of topics not known in advance E.g., for inferring clusters when number of clusters not known in advance § Directed trees of unbounded depth and breadth E.g., for inferring category structure § Sparse binary infinite dimensional matrices E.g., for inferring implicit features § Other stuff I don’t understand yet
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
10/25/10 Stick Breaking
Background image of page 8
10/25/10 Dirichlet Process
Background image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
10/25/10 Dirichlet Process 2
Background image of page 10
10/25/10 Drawing From A Dirichlet Process
Background image of page 11

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
10/25/10 Chinese Restaurant Process: Informal Description
Background image of page 12
10/25/10 Chinese Restaurant Process: Formal Description
Background image of page 13

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 14
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 10/24/2010 for the course CSCI 4202 at Colorado.

Page1 / 36

NonparametricBayes - Nonparametric Bayesian Models...

This preview shows document pages 1 - 14. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online