COMP 598 Applied Machine Learning
Lecture 2: Linear regression
!
Instructor: Joelle Pineau ([email protected])
TA: Mahdi Milani Fard ([email protected])
Class web page: www.cs.mcgill.ca/~jpineau/comp598
Todays Quiz
1. Define what is an or
CHAPTER 1
GENERATIVE AND DISCRIMINATIVE
CLASSIFIERS:
NAIVE BAYES AND LOGISTIC REGRESSION
Machine Learning
Copyright c 2005, 2010. Tom M. Mitchell. All rights reserved.
*DRAFT OF January 19, 2010*
*PLEASE DO NOT DISTRIBUTE WITHOUT AUTHORS
PERMISSION*
This
doi:10.1145/ 1400181. 1 40 0 2 0 2
Scene Completion Using Millions
of Photographs
By James Hays and Alexei A. Efros
Abstract
What can you do with a million images? In this paper, we
present a new image completion algorithm powered by a
huge database of ph
1
Representation Learning: A Review and New
Perspectives
Yoshua Bengio, Aaron Courville, and Pascal Vincent
Department of computer science and operations research, U. Montreal
arXiv:1206.5538v2 [cs.LG] 18 Oct 2012
!
Abstract
The success of machine learnin
Machine Learning that Matters
Kiri L. Wagsta
[email protected]
Jet Propulsion Laboratory, California Institute of Technology, 4800 Oak Grove Drive, Pasadena, CA 91109 USA
Abstract
Much of current machine learning (ML) research has lost its conn
2/12/2011
Linear Regression
CHAPTER 3: LINEAR MODELS FOR REGRESSION
Linear Regression (contd)
M 1
j =0
where x is the input, y, the output, wj is the model parameters, and j is the
basis function, and
=
( w
=
(
0
0
w
1
1
. w
.
M
M
1
1
)
)
Basis Function
REPORTS
larized nearly vertically. For completeness, Fig. 1B shows the off-resonant case for the smaller SRRs for vertical incident polarization. Although these results are compatible with the known selection rules of surface SHG from usual nonlinear opti
COMP-598: Applied Machine Learning
Quiz (in class). November 6 2013.
Name: _
Q1.
(Adapted from "Data Mining: Introductory and Advanced Topics" by M.H. Dunham,
Prentice Hall. 2003.)
Consider the following dataset with only
COMP-598: Applied Machine Learning
Quiz (in class). November 6 2013.
Name: _
Q1.
(Adapted from "Data Mining: Introductory and Advanced Topics" by M.H. Dunham,
Prentice Hall. 2003.)
Consider the following dataset with only
COMP-598: Applied Machine Learning
Quiz (in class). October 2 2013.
Name: _
Q1.
(a) Give decision trees that correctly represent the following Boolean functions:
i. Y = X1 AND X2
COMP-598: Applied Machine Learning
Quiz (in class). October 21 2013.
Name: _
Q1.
What is the role of the hidden layers in a neural network?
Q2.
A 3-input neuron is trained to output a zero
COMP-598: Applied Machine Learning
Quiz (in class). October 9 2013.
Name: _
Q1.
Consider the following L2 variant of the standard SVM primal formulation:
minimizew |w|2 + i=1:n i 2
COMP-598: Applied Machine Learning
Quiz (in class). October 2 2013.
Name: _
Q1.
(a) Give decision trees that correctly represent the following Boolean functions:
i. Y = X1 AND X2
COMP-598: Applied Machine Learning
Problem set (in class). September 21 2013.
5
[25 Points] Conditional Independence Violation (GradQ1. [Adapted from Tom Mitchells 2011 ML class at CMU.]
ing: Yi training a N
(a) Suppo
COMP-598: Applied Machine Learning
Quiz (in class). September 25 2013.
Name: _
Q1. Generative models of classification
Suppose you want to model some m-dimensional data set Xm, Y.
If you model X with a
COMP-598: Applied Machine Learning
Quiz (in class). September 25 2013.
Name: _
Q1. Generative models of classification
Suppose you want to model some m-dimensional data set Xm, Y.
If you model X with a
Locally Weighted Learning
Christopher G. Atkeson, Andrew W. Moorey, and Stefan Schaalz
College of Computing, Georgia Institute of Technology z 801 Atlantic Drive, Atlanta, GA 30332-0280
[email protected], [email protected] http:/www.cc.gatech.edu/fac/
COMP-598: Applied Machine Learning
Quiz (in class). September 16 2013.
Name: _
Q1. What is meant by the term overfitting? What can cause overfitting? How can
one avoid overfitting?
L10: Linear discriminants analysis
Linear discriminant analysis, two classes
Linear discriminant analysis, C classes
LDA vs. PCA
Limitations of LDA
Variants of LDA
Other dimensionality reduction methods
CSCE 666 Pattern Analysis | Ricardo Gutierrez-Osuna
COMP-598: Applied Machine Learning
Quiz (in class). September 16 2013.
Name: _
Q1. What is meant by the term overfitting? What can cause overfitting? How can
one avoid overfitting?
Overfitting occur