lecture_slides-Chapter 2.3

Lecture_slides-Chapter 2.3

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: be further, see Problems 28, 29, 30, 31, and S. W. Ho and R. W. Yeung, “On the discontinuity of the Shannon information measures,” IEEE Transactions of Information Theory, IT-56, no. 12, pp. 5362-5374, 2009. Thursday, 26 December, 13 Finite Alphabet vs Countable Alphabet • All Shannon’s information measures are continuous when the alphabets are fixed and finite. • For countable alphabets, Shannon’s information measures are everywhere discontinuous. • To probe further, see Problems 28, 29, 30, 31, and S. W. Ho and R. W. Yeung, “On the discontinuity of the Shannon information measures,” IEEE Transactions of Information Theory, IT-56, no. 12, pp. 5362-5374, 2009. Thursday, 26 December, 13 Definition 2.23 Let p and q be two probability distributions on a common alphabet...
View Full Document

This note was uploaded on 01/09/2014 for the course CIS 422 taught by Professor Raymondyeumg during the Spring '14 term at Bingham University.

Ask a homework question - tutors are online