Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774 Markov Random Field: Theory and Application
Sep 3, 2009
Lecture 1
Lecturer: Kyomin Jung
1
Scribe: Jaedeug Choi
Overview
In this lecture, we go over the graphical models that visualize the structure of the probabilistic models
using diagrammati
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774 Markov Random Field: Theory and Application
Sep 24, 2009
Lecture 7
Lecturer: Kyomin Jung
1
Scribe: Yohan Jo
Overview
In this lecture, we review the parametrization of MRFs, which we discussed in the last lecture, and go
over to the topic of up
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 16
Nov 03 2009
Lecturer: Kyomin Jung
Scribe: Sungsu Lim
1. Overview of the class
.
In the last class we studied about Gibbs sampling which is the most frequent used MCMC
method. Today we stu
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774 Markov Random Field: Theory and Application
Nov 10, 2009
Lecture 18
Lecturer: Kyomin Jung
1
Scribe: Eunsoo Oh
Overview
In this lecture, we study some approximation algorithms for MAP estimation and Logpartition
function estimation. These algo
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774 Markov Random Field: Theory and Application
Nov 5, 2009
Lecture 17
Lecturer: Kyomin Jung
1
Scribe: Eunsoo Oh
Overview
In this lecture, we study some examples of combinatorial optimization problems. It is already
known that nding the optimal so
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774 Markov Random Field: Theory and Application
Nov 12, 2009
Lecture 19
Lecturer: Kyomin Jung
1
Scribe: Dongwoo Kim
Overview
In this lecture, we study about a Hidden Markov Model (HMM) and a Conditional Random Field
(CRF)[1]. An HMM and CRF are pr
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774 Markov Random Field: Theory and Application
Nov 17, 2009
Lecture 20
Lecturer: Kyomin Jung
1
Scribe: Min Su Cho
Overview
In this lectue, we learn about learning positive binary MRF. We exploit the relation of the potential
function with Fourier
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 21
Nov 19 2009
Lecturer: Kyomin Jung
Scribe: Kanglin Kim
1. Overview of the class
In this class we study about application of MRF in Wireless Network Routing & Scheduling
by using MaxWeight
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
.
Sep 08 2009
Lecture 2
Lecturer: Kyomin Jung
Scribe: Dooho, Hwang
1 Overview of the class
In this lecture, we review the Markov Random Field and study its relevant problems. Markov Random Field (M
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 15
Oct 29 2009
Lecturer: Kyomin Jung
Scribe: Sungsu Lim
1. Overview of the class
In this class we study about sampling and Gibbs sampling which is a special case of MCMC
(Markov Chain Monte
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 14
Oct 27 2009
Lecturer: Kyomin Jung
Scribe: Boyoung Kim
1. Overview of the Class
Energy minimization generally refers to the problem of finding the x values at which a function
f(x) reaches
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 12
Oct 13 2009
Lecturer: Kyomin Jung
Scribe: Kanglin Kim
1. Overview of the class
Today we take a view of the concept of MRF in Computer Vision and its application and
useful example. Also w
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774 Markov Random Field: Theory and Application
Sep 10, 2009
Lecture 3
Lecturer: Kyomin Jung
1
Scribe: Min Su Cho
Overview
In this lecture, we study the Belief propagation algorithm(BP) and the Max Product algorithm(MP).
Last lecture reminds us of
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 4
Sep 15 2009
Lecturer: Kyomin Jung
Scribe: Jiyoung Jung
1. Overview
Today we study the loopy belief propagation algorithm, the computation tree and the
correlation decay. Last lecture remin
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
1
CS 774: Markov Random Fields: Theory and Application Lecture 5
Lecture by Kyomin Chung and Scribed by Youngchul Sung on Sep. 17, 2009
I. Recap and Introduction
The belief propagation algorithm rst introduced by Pearl in 1982 yields exact marginal proba
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 6
Sep 22 2009
Lecturer: Kyomin Jung
Scribe: Hangyu Kim
1. Overview
In this lecture, we review the Tree Decomposition (Junction Tree), study Hugin algorithm and
Dynamic programming on Junctio
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 8
Sep 29 2009
Lecturer: Kyomin Jung
Scribe: Kanghoon Lee
1. Overview of the class
In this lecture, we review the exponential family.
And we go over to the topics of upper
bound on logpartit
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 9
Oct 01 2009
Lecturer: Kyomin Jung
Scribe: Seungbum Jo
1. Overview of the class
Today we study a basic of coding theory that MRF can be applied. We study concept of error
correcting code, H
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 10
Oct 06 2009
Lecturer: Kyomin Jung
Scribe: Boyoung Kim
1. Overview of the class
Today we review Hamming code and study LDPC code. We take a view of the concept of
.
LDPC code and its decod
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774 Markov Random Field: Theory and Application
Oct 15, 2009
Lecture 13
Lecturer: Kyomin Jung
1
Scribe: Lim, Yongsub
Overview
In this lecture, we study the labeling problem in computer vision. In this problem, each pixel of
given image is assigned
Korea Advanced Institute of Science and Technology
Markov Random Field: Theory and Application
ENGINEERIN CS774

Fall 2009
KAIST CS774. Markov Random Field: Theory and Application
Lecture 11
Oct 08 2009
Lecturer: Kyomin Jung
Scribe: Yongsub Lim
1. Overview
In this lecture, we study the random 3
3SAT problem, wellknown and fundamental NP
known
NPcomplete problem.
3SAT prob