1.
A band called Radiohead is inspired by an old band called The Beatles. 90%
of music critics think the beatles was a great (G) band, 10% that it was mediocre
(M) and 0% that it was awful (A). Those
Unsupervised Learning
Clustering: Learning Goals
Let D be our dataset consisting of data objects cfw_x1,
, xd
Clustering seeks to answer the question:
1.
2.
3.
4.
5.
Unsupervised vs supervised learni
Assignment 6
Question 1.1
Odds ratio
Linear model
Objective function
Question 1.1
Odds ratio
Linear model
Starting from equation 1
First step
replace
with
using the fact that,
+
=
Second step
Objectiv
CPSC 340:
Machine Learning and Data Mining
Outlier Detection
Fall 2015
Admin
Midterm on Friday.
Assignment 3 solutions posted.
Practice midterm posted (fixed typos in Q1 and Q2 solutions).
List of to
CPSC 340:
Machine Learning and Data Mining
Mark Schmidt
University of British Columbia
Fall 2015
Outline
1) Intro to Machine Learning and Data Mining:
Big data phenomenon and types of data.
Definition
Admin
Assignment 1 is out (due next Friday, start early).
Tutorials start Monday:
11am, 2pm, and 4pm in DMP 201.
New tutorial section: 5pm in DMP 101.
Make sure you sign up for one.
No requirement t
CPSC 340:
Machine Learning and Data Mining
Principal Component Analysis
Fall 2015
Admin
Midterm on Friday.
Assignment 3 solutions posted after class.
Practice midterm posted.
List of topics posted.
I
ctor
e
v
ach
e
2
3
32x 24
0
or 1
Eigenvectors (Eigenfaces)
e
ag
im
e
On
kxd
Each eigenvector is 32x32
Eigenvectors (Eigenfaces)
e
ag
im
e
On
Change the value of k to get
more eigenvectors
kxd
Each eig
CPSC 340:
Machine Learning and Data Mining
Ensemble Methods
Fall 2015
Admin
Friday is last day to hand in Assignment 1.
Solutions posted after class Friday.
Assignment 2 is up, due next Friday.
We
CPSC 340:
Machine Learning and Data Mining
Sparse Matrix Factorization
Fall 2015
Admin
Assignment 2 grades posted.
Midterm back soon.
Assignment 4 out tomorrow.
Tomorrow at 6pm is DataSenses Data Scie
CPSC 340:
Machine Learning and Data Mining
Deep Learning
Fall 2015
Admin
Assignment 4 due now.
Midterm
After class pick up remaining/remarked midterms.
Missing cheat sheet: did someone grab one wh
CPSC 340:
Machine Learning and Data Mining
Discrete Labels
Fall 2015
Admin
Assignment 5 is posted.
Due Friday of next week.
A2.2 update: use k = 10.
http:/www.october212015.com/
Last Time: Convolut
CPSC 340:
Machine Learning and Data Mining
Density-Based Clustering
Fall 2015
Admin
Tutorials today.
Office hours tomorrow
Assignment 2 due Friday.
K-Means+
Steps of k-means+:
1. Select initial me
CPSC 340:
Machine Learning and Data Mining
Ranking
Fall 2015
Admin
Assignment 1-3 mark breakdowns posted.
Assignment 5:
Due Friday.
Updated a5.pdf: for example_movies use nRatings.
Updated a5.zip: m
CPSC 340:
Machine Learning and Data Mining
Multi-Dimensional Scaling
Fall 2015
Admin
Pick up midterm at the end of class.
Assignment 4 due Friday of next week.
Re-download it, fixed Q2 typos (eigen
CPSC 340:
Machine Learning and Data Mining
Markov Chains
Fall 2015
Admin
Assignment 6 due Friday.
Final exam details:
December 15: 8:30-11 (WESB 100).
4 pages of cheat sheet allowed.
9 questions.
Pr
CPSC 340:
Machine Learning and Data Mining
Hierarchical Clustering
Fall 2015
Admin
Assignment 2 due Friday:
Submit everything (including code) in a PDF file.
Extra office hours:
3-4pm on Thursdays
CPSC 340:
Machine Learning and Data Mining
Markov Chains
Fall 2015
Admin
Assignment 6 due Friday.
Error in Q1.1 fixed: should be able to get to logistic loss.
We will have office hours as usual nex
CPSC 340:
Machine Learning and Data Mining
Spectral Clustering
Fall 2015
Admin
Assignment 5 due Friday:
For ISOMAP, graph should be undirected/symmetric.
Include i-j if i is a neighbour of j or j i
CPSC 340:
Machine Learning and Data Mining
Association Rules
Fall 2015
Admin
Assignment 2 due now.
Assignment 3 out Monday.
Change the due date to have an extra tutorial?
Probably means moving the
CPSC 340:
Machine Learning and Data Mining
Robust Regression
Fall 2015
Admin
Can you see Assignment 1 grades on UBC connect?
Auditors, dont worry about it.
You should already be working on Assignme
Overview of Big-O Notation
Mark Schmidt
September 14, 2015
Review of Big-O Notation
- The notation g(n) = O( f(n) ) means:
- for all large n, g(n) less than c*f(n) for some constant c > 0.
- Examples:
CPSC 340:
Machine Learning and Data Mining
Semi-Supervised Learning
Fall 2015
Admin
Assignment 3 grades posted this weekend (with mark breakdowns).
Assignment 5:
Tutorial slides posted.
Due Friday
CPSC 340:
Machine Learning and Data Mining
Supervised Learning and
Decision Tree Learning
September 14, 2015
Admin
Tutorials have started today:
11am, 2pm, and 4pm in DMP 201.
5pm in DMP 101.
Offi
CPSC 340:
Machine Learning and Data Mining
Decision Theory and
Non-Parametric Models
September 18, 2015
Admin
Assignment 2 out today, due Friday of next week, start early!
No tutorials today, there
CPSC 340:
Machine Learning and Data Mining
Regularization
Fall 2015
Admin
No tutorials/class Monday (holiday).
Radial Basis Functions
Alternative to polynomial bases are radial basis functions (RBFs
CPSC 340:
Machine Learning and Data Mining
Sequence Mining
Fall 2015
Admin
Assignment 5 due now.
Assignment 6 out: due Friday of next week.
Practice final coming next week.
Sequence Mining
Finding
CPSC 340:
Machine Learning and Data Mining
Linear Least Squares
Fall 2015
Admin
Assignment 3 out today.
Longer than other assignments, but due on October 23rd.
Midterm moved to October 30.
Covers
CPSC 340:
Machine Learning and Data Mining
Recommender Systems
Fall 2015
Admin
Assignment 4 posted:
Due Friday of next week.
Midterm being marked now.
http:/www.october212015.com/
Non-Negativity vs
CPSC 340 Assignment 6 (due December 2)
PageRank and Neural Networks
1
PageRank
In class we discuss the PageRank algorithm for ranking nodes in a graph, and how it can be viewed in terms
of a random wa
CPSC 340 Assignment 2 (due October 7)
K-Nearest Neighbours, Random Forests, K-Means, Density-Based Clustering
1
K-Nearest Neighbours
In this question we revisit the citiesSmall dataset from the previo
CPSC 340 Assignment 6 (due December 2)
PageRank and Neural Networks
1
PageRank
In class we discuss the PageRank algorithm for ranking nodes in a graph, and how it can be viewed in terms
of a random wa
CPSC 340 Assignment 4 (due November 14)
Linear Models Part 2
1
Logistic Regression with Sparse Regularization
If you run the function example logistic, it will:
1. Load a binary classification dataset
CPSC 340 Assignment 1 (due September 23)
Data Exploration, Decision Trees, Training and Testing, Naive Bayes
You can work on your own or in a group of 2. If you work in a group, please only hand in o