Denition 1. Def: A transformation (mapping) L : X Y from a vector space
X to a vector space Y (with the same scalar eld K ) is a linear transformation
1. L(x) = L(x) x X , K
2. L(x1 + x2 ) = L(x1 ) + L(x2 ) x1 , x2 X .
We call such tr
Suppose that the cfw_vj j =1 are a nite-dimensional orthobasis. In this case we
x, vj vj .
But what if x span(cfw_vj ) = V already? Then we simply have
x, vj vj
for all x V . This is often called the reprod
I II. Representation and Analysis of Systems
In this course we will focus much of our attention on linear systems. When our
input and output signals are vectors, then the system is a linear operator.
Suppose that L : X Y is a linear operato
So far, our approximation problem has been posed in an inner product space,
and we have thus measured our approximation error using norms that are induced by an inner product such as the L2 / 2 norms (or weighted L2 / 2 norms).
We begin with the simplest of discrete-time systems, where X = CN and Y =
CM . In this case a linear operator is just an M N matrix. We can generalize
this concept by letting M and N go to , in which case we can think of a linear
Poles and zeros
Suppose that X (z ) is a rational function, i.e.,
X (z ) =
P (z )
where P (z ) and Q(z ) are both polynomials in z . The roots of P (z ) and Q(z )
are very important.
Denition 1. A zero of X (z ) is a value of z for which X (z ) = 0
Stability, causality, and the z -transform
In going from
ak y [n k ] =
bk x [ n k ]
H (z ) =
Y (z )
X (z )
we did not specify an ROC. If we factor H (z ), we can plot the poles and zeros
in the z -plane as below.
Throughout the course we have been alluding to various Fourier representations.
We rst recall the appropriate transforms:
Fourier Series (CTFS) x(t): continuous-time, nite/periodic on [, ]
X [k ] =
The DTFT as an eigenbasis
We saw Parseval/Plancherel in the context of orthonormal basis expansions.
This begs the question, do F and F 1 just take signals and compute their
representation in another basis?
Lets look at F 1 : L2 [, ] 2 (Z) rst:
F 1 (X (
The z -transform
We introduced the z -transform before as
h[k ]z k
H (z ) =
where z is a complex number. When H (z ) exists (the sum converges), it can be
interpreted as the response of an LSI system with impulse response h[n] to
the input of z n . The
Hilbert Spaces in Signal Processing
What makes Hilbert spaces so useful in signal processing? In modern signal
processing, we often represent a signal as a point in high-dimensional space.
Hilbert spaces are spaces in which our geometry intuition from R3
Lower Bounds in Streaming
Norm estimation: (1+)-approximation of
|x|p, xRm, under a sequence of n
O(log(n+m)/2) bits for p(0,2]
Heavy hitters/sparse approximations
Streaming Algorithms, etc.
A data stream is a sequence of data that is too
large to be stored in available memory
(disk, memory, cache, etc.)
Satellite data fee
Information, Signals and Systems
Signal processing concerns primarily with signals and systems that operate
on signals to extract useful information. In this course our concept of a signal
will be very broad, encompassing virtually any dat
L2 Norm Estimation
L2 Norm Estimation
1 2 m
A stream is a sequence of updates (i,a)
Want to estimate |x|2 up to 1
Last week, we have seen how to do that for |x|0 :
Space: (1/ + log m)O(1)
I I. Signal Representations in Vector Spaces
We will view signals as elements of certain mathematical spaces. The spaces
have a common structure, so it will be useful to think of them in the abstract.
Denition 1. A set is a (possibly innite)
Metric spaces impose no requirements on the structure of the set M . We
will now consider more structured M , beginning by generalizing the familiar
concept of a vector.
Denition 1. Let K be a eld of scalars, i.e., K = R or C. Let V be a set
Last Few Lectures
Recap (last few lectures)
Update a vector x
Maintain a linear sketch
Can compute Lp norm of x
(in zillion different ways)
Can we do anything else ?
Can we do something about linea
Inner Product Spaces
Where normed vector spaces incorporate the concept of length into a vector
space, inner product spaces incorporate the concept of angle.
Denition 1. Let V be a vector space over K . An inner product is a function
, : V V K such that f
Estimating Lp Norms
Two algorithms for estimating L2 norm of a stream
A stream of updates (i,1) interpreted as
(fractional and negative updates also OK)
Algorithms maintain a linear sketch Rx, where R is a k
Analysis of Discrete-Time Linear
1.1.1 Denitions and Notation
A signal is a function: signal and function are synonymous. The two notions are
the same, and we will be using them interchangeably. The historical
CHAPTER 1. ANALYSIS OF DISCRETE-TIME LINEAR TIME-INVARIANT SYSTEMS
Domain of f ,
D, a set of T
Domain of S, system S
D, a set of
Range of f ,T
R, a set of T
Range of S, T
MEL ZG520: Digital Signal Processing
Due date : 7th May 2016
1. The following sequence represent one period of a sinusoidal sequence of the form x[n] =
Acos(0 n + ):
Determine the values of the parameters A, 0 and .