{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

lecture_10pt2

# lecture_10pt2 - Computational functional genomics(Spring...

This preview shows pages 1–8. Sign up to view the full content.

Computational functional genomics (Spring 2005: Lecture 10) David K. Gifford (Adapted from a lecture by Tommi S. Jaakkola) MIT CSAIL

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Topics Basic classification approaches decisions estimation variable selection Examples More advanced methods
Classification We can divide the large variety of classification approaches into roughly two main types 1. Generative build a generative statistical model e.g., mixture model 2. Discriminative directly estimate a decision rule/boundary e.g., logistic regression

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Generative approach to classification A mixture of two Gaussians, one Gaussian per class choice of class P ( class = 1) P ( class = 0) X N ( µ 1 , Σ 1 ) X N ( µ 0 , Σ 0 ) where X corresponds to, e.g., a tissue sample (expression levels across the genes). Three basic problems we need to address: 1. decisions 2. estimation 3. variable selection
Mixture classifier cont’d Examples X (tissue samples) are classified on the basis of which Gaussian better explains the new sample (cf. likelihood ratio test) log P ( X | µ 1 , Σ 1 ) P ( class = 1) > 0 class = 1 (1) P ( X | µ 0 , Σ 0 ) P ( class = 0) 0 class = 0 (2) where the prior class probabilities P ( class ) bias our decisions to- wards one class or the other. Decision boundary log P ( X | µ 1 , Σ 1 ) P ( class = 1) = 0 (3) P ( X | µ 0 , Σ 0 ) P ( class = 0)

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
Mixture classifier: decision boundary Equal covariances X N ( µ 1 , Σ) , class = 1 (4) X N ( µ 0 , Σ) , class = 0 (5) The decision rule is linear
Mixture classifier: decision boundary Unequal covariances X N ( µ 1 , Σ 1 ) , class = 1 (6) X N ( µ 0 , Σ 0 ) , class = 0 (7) The decision rule is quadratic

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}