15-859(B) Machine Learning Theory
Homework # 4.5
Due: end of March, 2007
Some time within the next 3 weeks, come talk with me (in person or by email) about your
plans for your class project.
A typical
15-859(B) Machine Learning Theory
Homework # 2
Due: February 13, 2012
Groundrules: Same as before. You should work on the exercises by yourself but may work
with a partner on the problems (just write
15-859(B) Machine Learning Theory
Avrim Blum
Lecture 4: January 30, 2012
Online Learning contd
* The Perceptron Algorithm
* Perceptron for Approximately Maximizing the Margins
* Kernel Functions
Plan
15-859(B) Machine Learning Theory
Homework # 4
Due: March 21, 2012
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write down w
15-859(B) Machine Learning
Theory
Avrim Blum
01/23/12
Lecture 2: Online learning I
Mistake-bound model:
Basic results, halving and StdOpt algorithms
Connections to information theory
Combining expert
Basic setting
15-859(B) Machine Learning
Theory
Examples are points x in instance space, like Rn.
Assume drawn from some probability distrib:
Lecture 11: More on why large margins
are good for learni
Reinforcement learning
and
Markov Decision Processes (MDPs)
15-859(B)
Avrim Blum
RL and MDPs
General scenario: We are an agent in some state. Have observations, perform actions, get rewards. (See ligh
15-859(B) Machine Learning Theory
Lecture 15: Learning from noisy data,
intro to SQ model
Avrim Blum
03/19/12
Hoeffding/Chernoff bounds: minimizing training
error will approximately minimize true err
15-859(B) Machine Learning
Learning finite state
environments
Avrim Blum
04/02/12
Consider the following setting
Say we are a baby trying to figure out
the effects our actions have on our
environment
Semi-Supervised Learning
15-859(B) Machine Learning Theory
Semi-Supervised Learning
Avrim Blum
02/29/12
The main models we have been studying (PAC,
mistake-bound) are for supervised learning.
Given
15-859(B) Machine Learning Theory
Homework # 1
Due: January 29, 2014
Groundrules:
Homeworks will generally consist of exercises, easier problems designed to give you
practice, and problems, that may
15-859(B) Machine Learning Theory
Homework # 2
Due: February 12, 2014
Groundrules: Same as before. You should work on the exercises by yourself but may work
with a partner on the problems (just write
15-859(B) Machine Learning Theory
Homework # 5
Due: April 2, 2014
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write down wh
15-859(B) Machine Learning Theory
Homework # 4
Due: March 19, 2014
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write down w
15-859(B) Machine Learning Theory
Homework # 6
Due: April 30, 2012
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write down w
15-859(B) Machine Learning Theory
Homework # 5
Due: April 4, 2012
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write down wh
15-859(B) Machine Learning Theory
Homework # 3
Due: February 22, 2012
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write dow
15-859(B) Machine Learning Theory
Homework # 3
Due: February 20, 2007
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write dow
15-859(B) Machine Learning Theory
Homework # 1
Due: January 30, 2007
Groundrules:
Homeworks will generally consist of exercises, easier problems designed to give you
practice, and problems, that may
15-859(B) Machine Learning Theory
Homework # 4
Due: March 6, 2007
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write down wh
15-859(B) Machine Learning Theory
Homework # 2
Due: February 8, 2007
Groundrules: Same as before. You should work on the exercises by yourself but may work
with a partner on the problems (just write d
15-859(B) Machine Learning Theory
Homework # 5
Due: April 10, 2007
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write down w
15-859(B) Machine Learning Theory
Homework # 6
Due: April 24, 2007
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write down w
Basic Supervised learning setting
w Examples are points x in instance space, like Rn.
w Labeled + or -.
w Assume drawn from some probability
distribution:
15-859(B) Machine Learning
Theory
Lecture 13:
15-859(B) Machine Learning
15Learning finite state
environments
Avrim Blum
03/29/07
Consider the following setting
Say we are a baby trying to figure out
the effects our actions have on our
environme
Machine learning can be used to
to
15-859(B) Machine Learning Theory
15Lecture 1: intro, models and basic
issues
Avrim Blum
01/16/07
recognize speech, steer cars/robots,
play games,
adapt programs to
15-859(B) Machine Learning Theory
Homework # 3
Due: February 26, 2014
Groundrules: Same as before. You should work on the exercises by yourself but may work
with others on the problems (just write dow