EntropyClass

EntropyClass - ELEMENTS OF INFORMATION THEORY The 7 Coin...

Info iconThis preview shows pages 1–9. Sign up to view the full content.

View Full Document Right Arrow Icon
ELEMENTS OF INFORMATION THEORY
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
The 7 coins look the same but one has a different weight a) What is the smallest number of tests using this scale to determine which is different b) How does this number change if you use the scale below? c) How does the answer change if you that the different one is lighter? The 7 Coin Problem d) In each case give the recipe that achieves this minimum number next
Background image of page 2
Morse Code 7 next
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
How much information you gain when you see this? How much information you gain when you see this? next Information Acquisition next or this??
Background image of page 4
THE UNIT OF INFORMATION The unit of information is the bit ’’ (binary digit) How many bits we need to store 1000 spins of the wheel A ? How many bits we need to store 1000 spins of the wheel B ? A B next To store the integer n we need log n bits 2
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
next next
Background image of page 6
next next
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Suppose a wheel is spun once and the outcome is Now the wheel was Are you surprised ? next
Background image of page 8
Image of page 9
This is the end of the preview. Sign up to access the rest of the document.

Page1 / 27

EntropyClass - ELEMENTS OF INFORMATION THEORY The 7 Coin...

This preview shows document pages 1 - 9. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online