Graphic Model.pdf

# Graphic Model.pdf - Machine Learning 10-701 Tom M Mitchell...

• Notes
• 17

This preview shows page 1 - 6 out of 17 pages.

1 Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University October 11, 2011 Today: Graphical models Bayes Nets: Representing distributions Conditional independencies Simple inference Simple learning Readings: Required: Bishop chapter 8, through 8.2 Graphical Models Key Idea: – Conditional independence assumptions useful – but Naïve Bayes is extreme! – Graphical models express sets of conditional independence assumptions via graph structure – Graph structure plus associated parameters define joint probability distribution over set of variables Two types of graphical models: – Directed graphs (aka Bayesian Networks) – Undirected graphs (aka Markov Random Fields) today

Subscribe to view the full document.

2 Graphical Models – Why Care? Among most important ML developments of the decade Graphical models allow combining: Prior knowledge in form of dependencies/independencies Prior knowledge in form of priors over parameters Observed training data Principled and ~general methods for Probabilistic inference – Learning Useful in practice Diagnosis, help systems, text analysis, time series models, ... Conditional Independence Definition : X is conditionally independent of Y given Z, if the probability distribution governing X is independent of the value of Y, given the value of Z Which we often write E.g.,
3 Marginal Independence Definition : X is marginally independent of Y if Equivalently, if Equivalently, if Represent Joint Probability Distribution over Variables

Subscribe to view the full document.

4 Describe network of dependencies Bayes Nets define Joint Probability Distribution in terms of this graph, plus parameters Benefits of Bayes Nets: Represent the full joint distribution in fewer parameters, using prior knowledge about dependencies Algorithms for inference and learning
5 Bayesian Networks Definition A Bayes network represents the joint probability distribution over a collection of random variables A Bayes network is a directed acyclic graph and a set of conditional probability distributions (CPD’s)

Subscribe to view the full document.

• Fall '11
• Mitchell,Tom
• Probability theory, Bayesian network

{[ snackBarMessage ]}

### What students are saying

• As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

Kiran Temple University Fox School of Business ‘17, Course Hero Intern

• I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

Dana University of Pennsylvania ‘17, Course Hero Intern

• The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

Jill Tulane University ‘16, Course Hero Intern