Mathematical Preliminaries
Scalar Concepts
The simplest object that we will be dealing with in this course is that of a scalar. A scalar is an
element of a eld F . A eld is a type of algebraic structure that has certain processes dened on
it. These proces
Regression
Overview
A major problem in machine learning is regression. Regression is aimed at prediction: we
want to t a model to a series of observations to predict the responses of new observations.
This problem can be described by a mapping f J K, wher
Principal Component Analysis (PCA)
Lecture Outline
Motivations
Applications
History
Basic Concept of PCA
Geometric Rationale of PCA
Assumptions of PCA
PRINCIPAL COMPONENT ANALYSIS (PCA)
MOTIVATIONS
Curse of Dimensionality As the number of features u
Dimensionality Reduction
Overview
For many machine learning applications, a major issue can arise when performing recognition in high-dimensional spaces. This issue is known as the curse of dimensionality: we have
too many parameter degrees of freedom for
Introduction
Recommended textbook
Title: Pattern Recognition and Machine
Learning
Author: Christopher M. Bishop
Publisher: Springer
Year: 2006
This is the recommended book for the class.
It provides much of the fundamentals for
the course. It also covers