Course Hero Logo

EECE 422 Lect 2.pdf - 9/19/2020 Information Theory and...

Course Hero uses AI to attempt to automatically extract content from documents to surface to you and others so you can study better, e.g., in search results, to enrich docs, and more. This preview shows page 1 - 6 out of 6 pages.

9/19/20201Information Theory and CodingEECE 422Current lectureBased on the concepts of structure and randomness, in this lecture, we will talk aboutConcepts of probability theorySurpriseEntropy
9/19/20202First concepts of probability theoryTo describe a phenomenon in terms of probability theory, we need to define a set of outcomes which is called sample space.Consider example of a coinConsider example of a dieSurpriseIn every day life, events surprise us.The lower the probability of occurring an event,
End of preview. Want to read all 6 pages?

Upload your study docs or become a

Course Hero member to access this document

Term
Fall
Professor
N/A
Tags
Information Theory, Probability theory

Newly uploaded documents

Show More

Newly uploaded documents

Show More

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture