Unsupervised and Reinforcement Learning in Neural Networks
LABORATORY CS464

Fall 2015
Unsupervised and reinforcement learning
in neural networks
Week 3
Lecturer: MarcOliver Gewaltig
Assistants: Dane Corneil
Berat Denizdurduran
Corrections: Whitening, Decorrelation &
Independence
Exercise 1
1.1. The definition of the expectation value1 of
Unsupervised and Reinforcement Learning in Neural Networks
LABORATORY CS464

Fall 2015
Unsupervised and reinforcement learning
in neural networks
Week 2
Lecturer: MarcOliver Gewaltig
Solutions: PCA & Ojas rule
Exercise 1
By looking at the formulation of the following learning rules, classify them to Hebbiantype or nonHebbian rules.
Variab
Unsupervised and Reinforcement Learning in Neural Networks
LABORATORY CS464

Fall 2015
Unsupervised and reinforcement learning
in neural networks
Week 3
Lecturer: MarcOliver Gewaltig
Assistants: Dane Corneil
Berat Denizdurduran
Whitening, Decorrelation & Independence
Exercise 1
1.1. In class: Prove that if x1 and x2 are statistically indep
Unsupervised and Reinforcement Learning in Neural Networks
LABORATORY CS464

Fall 2015
Unsupervised and reinforcement learning
in neural networks
Week 4
Lecturer: MarcOliver Gewaltig
Assistants: Dane Corneil
Berat Denizdurduran
Corrections: Independent Component
Analysis
Exercise 1
1.1. Lets calculate the second and fourth moments of y:
E[
Unsupervised and Reinforcement Learning in Neural Networks
LABORATORY CS464

Fall 2015
Unsupervised and reinforcement learning
in neural networks
Lecture 2
Lecturer: MarcOliver Gewaltig
PCA & Ojas rule
Exercise 1
By looking at the formulation of the following learning rules, classify them to Hebbiantype or nonHebbian rules.
Variable defin
Unsupervised and Reinforcement Learning in Neural Networks
LABORATORY CS464

Fall 2015
CS464 Unsupervised and Reinforcement
Learning in Neural Networks
Please use the Moodle page
Lectures: Mondays 10:0012:00
Exercises: Wednesdays 10:1512:00
13:1515:00
One wriHen exercise
Two
Unsupervised and Reinforcement Learning in Neural Networks
LABORATORY CS464

Fall 2015
Unsupervised and Reinforcement
Learning In Neural Networks
Fall 2015
Independent component analysis
Images from: Independent Component Analysis:
Algorithms and Applications, Neural Networks (2000)
by Hyvarinen and Oja
Moodle page: moodle.epfl.ch/course/vi
Unsupervised and Reinforcement Learning in Neural Networks
LABORATORY CS464

Fall 2015
Unsupervised and reinforcement learning
in neural networks
Week 4
Lecturer: MarcOliver Gewaltig
Assistants: Dane Corneil
Berat Denizdurduran
Independent Component Analysis
Exercise 1
In class, it was argued that a mixture of statistically independent sou