Chapter 3 :
Optimal Estimate Training
For OET, the activation function f( ) should be a continuous invertible
function such as the hyperbolic tangent (tanh).
The number of processing elements in the input layer, n, is the same as the
number of processing
0 .2 + 0 .3
Note that if the algebraic product is used to define A I B
i.e. A I B ( x) = A ( x) B ( x), then A I B = 0.1 + 0.12
Smallest t-norm any t-norm largest t-norm
A = 0.6 + 0.5 + 0.3 B = 0.2 + 0.4 + 0.9 A U B = 0.6 + 0.5 + 0.4 +
due to rule 1
due to rule 2
There are other ways of doing things:
e.g. simply set speed = 60%x1000+40%x500
Single value to represent the
resulting output speed
- (x - 15)
a number more than
two but not large
1 1 0.5
1 2 3
0.5 1 1 1 1 0.5
+ + + + +
3 4 5 6 7 8
0.5 1 1
8 9 10
These are not arithmetic operator
The Hopfield Network
Hopfield Neural Network
A recurrent neural network has feedback loops from its
outputs to the inputs. The presence of such loops has a
profound impact on the learning capability of the network.
How does the recurrent netw
Fundamental Questions of AI
Can machines think?
Is there mind without communication?
Is there language without living?
Is there intelligence without life?
September 2, 2013
Dr. Grantham Pang
Chapter 2 : Multilayer
Why do we need a hidden layer ?
What is a multilayer neural network ?
A multilayer neural network is a feedforward neural network
with one or more hidden layers.
The network consists of an input layer of source neu
The most common basis function chosen is a Gaussian
function, in which case the activation level hj of hidden unit j
is calculated by
Chapter 5 :
Radial Basis Function Networks
h j = exp[ ( X C j ) ( X C j ) / 2 j ]
A radial basis function (RBF) netwo
Can a neural network learn without a teacher ?
The main property of ANN is an ability to learn from its
environment, and to improve its performance through
learning. BP and OET are supervised or activ
COMP 328: Machine Learning
Lecture 2: Naive Bayes Classiers
Nevin L. Zhang
Department of Computer Science and Engineering
The Hong Kong University of Science and Technology
Nevin L. Zhang (HKUST)
1 / 34
Two dierent types o