class16-Informatio

class16-Informatio - Information and Randomness Bits How...

Info iconThis preview shows pages 1–13. Sign up to view the full content.

View Full Document Right Arrow Icon
Information and Randomness
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Bits How many bits do I need to store one boolean value? How many bits do I need to store the outcome of one home pregnancy test? A home pregnancy test reveals 1 bit of information. It may be the most important life-changing bit of information, but it's still just 1 bit.
Background image of page 2
Which has more information? 023514 795 084664452746 (A) (B) (C)
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Information More Digits = More Information Right?
Background image of page 4
Memorizing Volunteer to memorize 10 digits 2737761413 Volunteer to memorize 100 digits 4444444444444444444444444444444444444 4444444444444444444444444444444444444 44444444444444444444444444
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Memorizing 10-digit volunteer: What was the 8th digit? 100-digit volunteer: What was the 78th digit? Which is easier to memorize? Which contains more information?
Background image of page 6
Memorizing Another volunteer to memorize 100 digits 4859937766824805299839179081504751450913 5243678006736228445539731692238204213061 74607612086978543115 Is that harder to memorize than: 4444444444444444444444444444444444444444 4444444444444444444444444444444444444444 44444444444444444444 Why? Which contains more information?
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Information: a definition The amount of information in a sequence of digits is equal to the length of the shortest program that prints those digits.
Background image of page 8
Write a program to print 44444444444444444444444444444444 44444444444444444444444444444444 44444444444444444444444444444444 4444 repeat 100: print "4"
Background image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Write a program to print 4859937766824805299839179081504751 4509135243678006736228445539731692 23820421306174607612086978543115 print "4859937766824805299839179081504 75145091352436780067362284455397 31692238204213061746076120869785 43115"
Background image of page 10
Memorizing Programs print "4859937766824805299839179081504 75145091352436780067362284455397 31692238204213061746076120869785 43115" is harder to memorize than repeat 100: print "4"
Background image of page 11

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Therefore 4859937766824805299839179081504751
Background image of page 12
Image of page 13
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 09/14/2010 for the course CS 15-100 taught by Professor Dave during the Spring '08 term at Carnegie Mellon.

Page1 / 40

class16-Informatio - Information and Randomness Bits How...

This preview shows document pages 1 - 13. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online