Group 1 - Scott Cullinane and Cynthia Parsons Finding the...

Info iconThis preview shows pages 1–4. Sign up to view the full content.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: Scott Cullinane and Cynthia Parsons Finding the entropy of an information source is a good way of determining its quality. Example: A lawyer gives you a 10-page legal document that basically says The sky is blue. The amount of information you gain per character he used is extremely low. It has a very low entropy You know that as an information source, this 10-page document is poor quality. But how would you quantify its quality? Entropy is a good way of quantifying just how good (or bad) the transmission of information from the source to the receiver is. Based in probability of a given symbol occurring. The amount of information delivered by the messages is known as the entropy of the source they came from. Example: There are 5 weekdays, and 2 weekends per week. If you asked someone What day is it today? Their response: A weekend day This means there are only two possible days it could be today, down from 7....
View Full Document

This note was uploaded on 07/24/2011 for the course EEL 3531 taught by Professor Llewelyn during the Spring '09 term at University of Florida.

Page1 / 8

Group 1 - Scott Cullinane and Cynthia Parsons Finding the...

This preview shows document pages 1 - 4. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online