4 comparison with lda 1441 by example 15 20091021 151

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: omparison with LDA 14.4.1 By example 15 2009.10.21 15.1 Multi- Class Logistic Regression 15.2 Multi- class kernel logistic regression 15.3 Perceptron (Foundation of Neural Network) 15.3.1 Separating Hyperplane Classifiers 15.3.2 Perceptron 15.3.3 A Perceptron Example 16 The Perceptron (Lecture October 23, 2009) 16.1 Problems with the Algorithm and Issues Affecting Convergence 16.2 Comment on gradient descent algorithm 17 Neural Networks (NN) - October 28, 2009 17.1 Introduction 17.2 Activation Function 17.3 Back- propagation 18 Neural Networks (NN) - October 30, 2009 18.1 Back- propagation 18.1.1 How to initialize the weights 18.1.2 How to set learning rates 18.1.3 How to determine the number of hidden units 18.2 Dimensionality reduction application 18.3 Deep Neural Network 18.3.1 Difficulties of training deep architecture [12] 18.4 Neural Networks in Practice 18.5 Issues with Neural Network 18.6 BUSINESS APPLICATIONS OF NEURAL NETWORKS 19 Complexity Control October 30, 2009 20 Complexity Control - Nov 2, 2009 20.1 How do we choose a good classifier? 20.2 Example of under and overfitting in R 21 Cross- Validation (CV) - Introduction 22 Complexity Control - Nov 4, 2009 23 Cross- validation 23.1 K- fold Cross- validation 23.2 Generalized Cross- validation 23.3 Leave- one- out Cross- validation 24 Regularization for Neural Network — Weight Decay 25 Radial Basis Function (RBF) Networks - November 6, 2009 25.1 Introduction 25.2 Estimation of weight matrix W 25.2.1 Useful properties of matrix differentiation 25.2.2 Solving for W 25.3 Including an additional bias 25.3.1 Normalized RBF 25.4 Conceptualizing RBF networks 25.5 RBF networks for classification - - a probabilistic paradigm 26 Radial Basis Function (RBF) Networks - November 9th, 2009 26.1 RBF Network for classification (A probabilistic point of view) 26.1.1 Interpretation of RBF Network classification 26.2 Model selection or complexity control for RBF Network - a brief introduction 27 Model Selection(Stein's Unbiased Risk Estimate)- November 11th, 2009 27....
View Full Document

This document was uploaded on 03/07/2014.

Ask a homework question - tutors are online