Presentation_IsabelleLaureyns_Final

Presentation_IsabelleLaureyns_Final - Introduction The...

Info iconThis preview shows pages 1–8. Sign up to view the full content.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: Introduction The Basic Idea of DBP How DBP works Applications Concluding Remarks References Dynamic Backpropagation ME697Y - Intelligent Systems Isabelle A. G. Laureyns February 2, 2010 1 / 23 Introduction The Basic Idea of DBP How DBP works Applications Concluding Remarks References Outline 1 Introduction Backpropagation What is Dynamic Backpropagation? 2 The Basic Idea of DBP 3 How DBP works General Setup Equilibrium Points Algorithm 4 Applications 5 Concluding Remarks 6 References 2 / 23 Introduction The Basic Idea of DBP How DBP works Applications Concluding Remarks References Backpropagation What is Dynamic Backpropagation? Outline 1 Introduction Backpropagation What is Dynamic Backpropagation? 2 The Basic Idea of DBP 3 How DBP works General Setup Equilibrium Points Algorithm 4 Applications 5 Concluding Remarks 6 References 3 / 23 Introduction The Basic Idea of DBP How DBP works Applications Concluding Remarks References Backpropagation What is Dynamic Backpropagation? Backpropagation Descent in weight space (a) small learning rate - (b) large learning rate - (c) large learning rate and momentum 4 / 23 Introduction The Basic Idea of DBP How DBP works Applications Concluding Remarks References Backpropagation What is Dynamic Backpropagation? Backpropagation Can be used for training of patterns in recurrent networks Deficiencies: Long training process (result of a non-optimum learning rate or momentum) Some algorithms adapt the learning rate Network paralysis Local minima 5 / 23 Introduction The Basic Idea of DBP How DBP works Applications Concluding Remarks References Backpropagation What is Dynamic Backpropagation? Network Paralysis Example of network paralysis 6 / 23 Introduction The Basic Idea of DBP How DBP works Applications Concluding Remarks References Backpropagation What is Dynamic Backpropagation?...
View Full Document

This note was uploaded on 12/29/2011 for the course ME 680 taught by Professor Na during the Fall '10 term at Purdue University-West Lafayette.

Page1 / 23

Presentation_IsabelleLaureyns_Final - Introduction The...

This preview shows document pages 1 - 8. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online