SPR_LectureHandouts_Chapter_05_part2_LearningWeights

SPR_LectureHandouts_Chapter_05_part2_LearningWeights -...

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: Pattern Recognition ECE-8443 Chapter 5: Learning Weights of the Linear (/Generalized Linear) Discriminant Function – Gradient Descent Method Electrical and Computer Engineering Department, Mississippi State University. 1 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department 2 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department 3 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department • Generic descent algorithm • Generalization to multiple dimensions • Problems of descent methods, possible improvements • Fixes • Local minima 4 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Generic descent algorithm: Minimum of a function is found by following the slope of the function 5 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department 6 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department 7 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department 8 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department 9 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Generic descent algorithm: •Start with a point (guess) •Repeat •Determine a descent direction •Choose a step •Update •Until stopping criterion is satisfied 10 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Generic descent algorithm: •Start with a point (guess) •Repeat •Determine a descent direction •Choose a step •Update •Until stopping criterion is satisfied 11 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Generic descent algorithm: •Start with a point (guess) •Repeat •Determine a descent direction •Choose a step •Update •Until stopping criterion is satisfied 12 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Generic descent algorithm: •Start with a point (guess) •Repeat •Determine a descent direction •Choose a step •Update •Until stopping criterion is satisfied 13 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Generic descent algorithm: •Start with a point (guess) •Repeat •Determine a descent direction •Choose a step •Update •Until stopping criterion is satisfied 14 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 15 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 16 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 17 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 18 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 19 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 20 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 21 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 22 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 23 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 24 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in Two-dimensions: 25 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 26 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 27 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 28 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 29 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 30 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 31 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 32 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 33 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department Gradient descent algorithm in N-dimensions: 34 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department 35 Chapter 5 Saurabh Prasad Pattern Recognition Electrical and Computer Engineering Department ...
View Full Document

This note was uploaded on 02/20/2012 for the course ECE 8443 taught by Professor Staff during the Spring '10 term at University of Houston.

Ask a homework question - tutors are online