1.
A band called Radiohead is inspired by an old band called The Beatles. 90%
of music critics think the beatles was a great (G) band, 10% that it was mediocre
(M) and 0% that it was awful (A). Those critics have also compiled the
following Markov transit
Unsupervised Learning
Clustering: Learning Goals
Let D be our dataset consisting of data objects cfw_x1,
, xd
Clustering seeks to answer the question:
1.
2.
3.
4.
5.
Unsupervised vs supervised learning
Partitioning vs hierarchical methods
Distance functi
CPSC 340:
Machine Learning and Data Mining
Decision Theory and
Non-Parametric Models
September 18, 2015
Admin
Assignment 2 out today, due Friday of next week, start early!
No tutorials today, there will be office hours tomorrow.
Course drop deadline to
CPSC 340:
Machine Learning and Data Mining
Sparse Matrix Factorization
Fall 2015
Admin
Assignment 2 grades posted.
Midterm back soon.
Assignment 4 out tomorrow.
Tomorrow at 6pm is DataSenses Data Science Seminar Series:
IBM Watson Analytics and Panel Dis
CPSC 340:
Machine Learning and Data Mining
Deep Learning
Fall 2015
Admin
Assignment 4 due now.
Midterm
After class pick up remaining/remarked midterms.
Missing cheat sheet: did someone grab one when returning midterms?
Office hours on Tuesday of next
CPSC 340:
Machine Learning and Data Mining
Discrete Labels
Fall 2015
Admin
Assignment 5 is posted.
Due Friday of next week.
A2.2 update: use k = 10.
http:/www.october212015.com/
Last Time: Convolutional Neural Networks
Convolutional neural networks:
1
CPSC 340:
Machine Learning and Data Mining
Density-Based Clustering
Fall 2015
Admin
Tutorials today.
Office hours tomorrow
Assignment 2 due Friday.
K-Means+
Steps of k-means+:
1. Select initial mean 1, from among the object xi.
2. Compute distance dic
CPSC 340:
Machine Learning and Data Mining
Ranking
Fall 2015
Admin
Assignment 1-3 mark breakdowns posted.
Assignment 5:
Due Friday.
Updated a5.pdf: for example_movies use nRatings.
Updated a5.zip: missing n in example_MDS, dijkstra function missing.
Tut
CPSC 340:
Machine Learning and Data Mining
Multi-Dimensional Scaling
Fall 2015
Admin
Pick up midterm at the end of class.
Assignment 4 due Friday of next week.
Re-download it, fixed Q2 typos (eigenvalues of XX vs. singular values of X).
Some Assignmen
CPSC 340:
Machine Learning and Data Mining
Markov Chains
Fall 2015
Admin
Assignment 6 due Friday.
Final exam details:
December 15: 8:30-11 (WESB 100).
4 pages of cheat sheet allowed.
9 questions.
Practice questions and list of topics posted.
Last Time:
CPSC 340:
Machine Learning and Data Mining
Ranking
Fall 2016
Admin
Assignment 5:
2 late days to hand in Wednesday, 3 for Friday.
Assignment 6:
Due Friday, 1 late day to hand in next Monday, etc.
Final:
December 12 (8:30am HEBB 100)
Covers Assignments
CPSC 340:
Machine Learning and Data Mining
Deep Learning
Fall 2016
Admin
Assignment 5:
Due Friday.
Assignment 6:
Due next Friday.
Final:
December 12 (8:30am HEBB 100)
Covers Assignments 1-6.
Final from last year and list of topics will be posted.
Clo
CPSC 340:
Machine Learning and Data Mining
Kernel Methods
Fall 2016
Admin
Assignment 2:
Solution posted.
Assignment 3:
Due Wednesday (before midnight anywhere on Earth).
Solutions released next Wednesday after class (last possible late class).
Midte
CPSC 340:
Machine Learning and Data Mining
Stochastic Gradient
Fall 2016
Admin
Assignment 3:
3 late days before class Wednesday.
Solutions will be posted after class Wednesday.
Extra office hours Thursday:
10:30-12 and 4:30-6 in X836.
Midterm Friday
CPSC 340:
Machine Learning and Data Mining
Hierarchical Clustering
Fall 2016
Admin
Assignment 1 :
3 late days to hand it in before Friday.
0 after that.
Assignment 2 is out:
Due Friday of next week, but start early!
Calculus and linear algebra terms
CPSC 340:
Machine Learning and Data Mining
Ensemble Methods
Fall 2015
Admin
Friday is last day to hand in Assignment 1.
Solutions posted after class Friday.
Assignment 2 is up, due next Friday.
We will have standardized tutorials every week.
K-Nearest
ctor
e
v
ach
e
2
3
32x 24
0
or 1
Eigenvectors (Eigenfaces)
e
ag
im
e
On
kxd
Each eigenvector is 32x32
Eigenvectors (Eigenfaces)
e
ag
im
e
On
Change the value of k to get
more eigenvectors
kxd
Each eigenvector is 32x32
Eigenvectors (Eigenfaces)
Compressed
CPSC 340:
Machine Learning and Data Mining
Supervised Learning and
Decision Tree Learning
September 14, 2015
Admin
Tutorials have started today:
11am, 2pm, and 4pm in DMP 201.
5pm in DMP 101.
Office hours tomorrow:
10am in ICICS X836
4pm in ICICS 14
CPSC 340:
Machine Learning and Data Mining
Regularization
Fall 2015
Admin
No tutorials/class Monday (holiday).
Radial Basis Functions
Alternative to polynomial bases are radial basis functions (RBFs):
Basis functions that depend on distances to trainin
CPSC 340:
Machine Learning and Data Mining
Sequence Mining
Fall 2015
Admin
Assignment 5 due now.
Assignment 6 out: due Friday of next week.
Practice final coming next week.
Sequence Mining
Finding patterns in data organized according to a sequence:
C
CPSC 340:
Machine Learning and Data Mining
Linear Least Squares
Fall 2015
Admin
Assignment 3 out today.
Longer than other assignments, but due on October 23rd.
Midterm moved to October 30.
Covers Assignments 1-3.
Practice midterm coming.
User-Product
CPSC 340:
Machine Learning and Data Mining
Recommender Systems
Fall 2015
Admin
Assignment 4 posted:
Due Friday of next week.
Midterm being marked now.
http:/www.october212015.com/
Non-Negativity vs. L1-Regularization
Last time we discussed how non-neg
CPSC 340:
Machine Learning and Data Mining
Course Review/Preview
Fall 2015
Admin
Assignment 6 due now.
We will have office hours as usual next week.
Final exam details:
December 15: 8:30-11 (WESB 100).
4 pages of cheat sheet allowed.
9 questions.
Pract
CPSC 340:
Machine Learning and Data Mining
Logistic Regression
Fall 2015
Admin
Assignment 3 due Friday:
Submit as a single PDF file.
Features with Different Scales
Consider features with different scales:
Egg (#)
Milk (mL)
Fish (g)
Pasta (cups)
0
250
0
CPSC 340:
Machine Learning and Data Mining
Conditional Probability and Generative Models
September 18, 2015
Admin
Assignment 1 was due at 3pm.
1 late day if you hand it in before Monday at 3pm.
2 late days if you hand it in before Wednesday at 3pm.
Youve
CPSC 340:
Machine Learning and Data Mining
Hierarchical Clustering
Fall 2015
Admin
Assignment 2 due Friday:
Submit everything (including code) in a PDF file.
Extra office hours:
3-4pm on Thursdays in X836.
Calculus and linear algebra terms to review
CPSC 340:
Machine Learning and Data Mining
Outlier Detection
Fall 2015
Admin
Midterm on Friday.
Assignment 3 solutions posted.
Practice midterm posted (fixed typos in Q1 and Q2 solutions).
List of topics posted.
In class, 55 minutes, closed-book, cheat s
CPSC 340:
Machine Learning and Data Mining
Mark Schmidt
University of British Columbia
Fall 2015
Outline
1) Intro to Machine Learning and Data Mining:
Big data phenomenon and types of data.
Definitions of data mining and machine learning.
Applications and
Admin
Assignment 1 is out (due next Friday, start early).
Tutorials start Monday:
11am, 2pm, and 4pm in DMP 201.
New tutorial section: 5pm in DMP 101.
Make sure you sign up for one.
No requirement to attend, but helps with assignment.
Office hours:
Be
CPSC 340 2016W2
Final Exam
CPSC 340, 2016W2: SOLUTIONS TO FINAL EXAM
Question 1.
(28 points)
For each method below, name one advantage and one disadvantage of using that method. If
you list more than one, only the first will be graded. Please keep your an
CPSC 340
Midterm Exam
CPSC 340, 2016W2: SOLUTIONS TO MIDTERM EXAM
Question 1.
(25 points)
Circle all that apply. There may be zero correct choices or multiple correct choices, not
necessarily just one! No need to justify your answer.
6 pts
(a) Which of th