This preview shows pages 1–3. Sign up to view the full content.
Notes on Probability and Random Variables
Optimal Estimation (EML 6934, Section 6385)
Fall 2009
University of Florida, Mechanical and Aerospace Engineering
Prabir Barooah
*
1
Probability
1.1
Random Experiment
Everything is based on a “random experiment”, which is a mathematical model for some unpredictable
phenomenon.
All possible outcomes of the random experiment are collected in a set Ω, which is called the
sample
space
. Examples:
1. A die is thrown : possible outcomes are “1 dot”, “2 dots”, .
.., “6 dots”. Then Ω =
{
1 dot
,
2 dots
,...,
6 dots
}
2. A coin is tossed twice. Then Ω =
{
HH,HT,TH,TT
}
.
3. System identiFcation experiment described in class: Ω consists of all possible values of the paur
(ˆ
a
d
,
ˆ
b
d
).
An event is a collection of such outcomes. Examples:
1. (in the die toss experiment)
E
Δ
=
{
1
,
2
,
4
,
6
}
. This is the event that an even number of dots turn
up.
2. (in the system identiFcation experiment)
E
Δ
=
{
ˆ
a
d
<
1
}
. (What’s this event?)
In general, and event
E
is a subset of the sample space, i.e.,
E
⊂
Ω. Based on the sample space Ω, a
larger set
F
is deFned:
F
=
{
E

E
⊆
Ω
,E
is “measurable”
}
which is called a
σ
feld or
σ
algebra
. We will not go into what a measurable set is. ±or the purpose
of this course, you can take it that all sets are measurable, so that every subset of Ω is an element of
the
σ
algebra
F
. Think of
F
as the set of all events.
F
contains Ω and
φ
, the sample space and the
empty set, among other events. When Ω is thought of as an event (an element of
F
), it is called the
sure event.
φ
is called the impossible event.
There are several ways of thinking of probability.
*
Please email me at [email protected] iF you ±nd any typos.
1
This preview has intentionally blurred sections. Sign up to view the full version.
View Full Document 1.
Probability as the relative frequency of occurrence
: do the underlying random experiment
a very large number of times. Probability of an event is the ratio between the number of times
the event occurs to the total number of experiments.
2.
Probability as the ratio of favorable to all possible outcomes:
Example: say the event
E
= an even number of dots appear when a die is thrown. The favorable outcomes, for which
the event is said to occur, are 2
,
4
,
6, whereas all the possible outcomes are 1
,...,
6. Then,
probability of
E
is 3
/
6, i.e., 1
/
2. Note that all the outcomes are assumed to be equally likely for
this calculation to make sense.
3.
Modern, or axiomatic, deFnition of probability:
A probability
P
is a function that assigns
a number between 0 and 1 to every event, i.e., to every element of the
σ
Feld
F
. Therefore,
probability is a function
P
:
F
→
[0
,
1]
that satisFes the following axioms:
•
P
(
E
)
≥
0 for every
E
∈
F
.
This is the end of the preview. Sign up
to
access the rest of the document.
This note was uploaded on 07/03/2011 for the course EML 6934 taught by Professor Staff during the Fall '08 term at University of Florida.
 Fall '08
 Staff

Click to edit the document details