Ch. 8 Math Preliminaries for
Lossy Coding
8.5 Rate-Distortion Theory
1
Introduction
Theory provide insight into the trade between
Rate & Distortion
This theory is needed to answer:
What do typical R-D curves look like?
What factors impact the R-D trad

Ch. 3 Huffman Coding
1
Two Requirements for Optimum Prefix Codes
1.
2.
Likely Symbols
Short Codewords
Unlikely Symbols
Long Codewords
<Recall Entropy Discussion>
The two least likely symbols have codewords of the
same length
Why #2?
Suppose two least lik

Review of Probability
(for Lossless Section)
For Details See:
Appendix A in text book
Ch. 10 in Lathis Book
1
Probability
Motivate with Frequency of Occurrence Viewpoint
Consider N Events: 1, 2, N
Conduct Experiment nT times
and let
ni = # of times event

EECE 523
Ch. 1
Introduction
&
Lossless Example
I. Introduction
Wht is Dta Cmprsn? The systematic removal and, later,
reintroduction of redundancy from data, and possibly also
the removal of insignificant data.
Original Data
(or Close)
Approximation
Contai

Ch. 8 Math Preliminaries for
Lossy Coding
8.3 Distortion Criteria or Measure
1
Structure of Lossy Coding
In practice this is how things get
implemented. The A/D not only
samples x(t) in time but it also
discretizes the values however,
the discretization i