3Amount of Information - log 2 (1) – log 2 p = –log 2 p...

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
Amount of Information (H) H = log 2 k where H = am’t of information in bits, and k = # of equally probable alternatives. k = 1/pwhere p = probability of each item. H = log 2 (1/p) =
Background image of page 1
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: log 2 (1) – log 2 p = –log 2 p = information of a given message. H = – Σ p i log 2 p i bits/symbol = average information of a source (or message ensemble)....
View Full Document

This note was uploaded on 08/12/2008 for the course PSY 387R taught by Professor Diehl during the Spring '07 term at University of Texas at Austin.

Ask a homework question - tutors are online