ELEC1010 assignment4.pdf - Name Fung Chun Sing 1 1 Entropy...

Info icon This preview shows pages 1–2. Sign up to view the full content.

View Full Document Right Arrow Icon
Name: Fung Chun Sing 20200230 1. 1) Entropy = 7 280 log 280 7 + 5 280 log 280 5 + 23 280 log 280 23 + 245 280 log 280 245 = 0.701499642 bits/symbol By Shannon’s entropy formula , the minimum is 0.701 bits/symbol. 2) i) Number of Symbols Symbol Set Possible Codewords 4 {20, 30, 40 ,60} 00, 01, 10, 11 ii) Average = 7 280 *2 + 5 280 *2+ 23 280 *2+ 245 280 *2 = 2 bits/symbol 3) i) Four symbols with probabilities: 20: 7 280 , 30: 5 280 , 40: 23 280 , 60: 245 280 Grade (Symbol) Codewords 20 110 30 111 40 10 60 0 ii) Avg. bit/sym = 7 280 *3 + 5 280 *3+ 23 280 *2+ 245 280 *1 = 1.168 bits
Image of page 1

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Name: Fung Chun Sing 20200230 2. 1) Input bit = 10111101110001001010 Encoded bit sequence = 10111 11011 11000 01001 10100 2) Encoded = 11101000011010101001 = 11101 00001 10101 01001 We can see that only the second(00001) and the third block(10101) have odd
Image of page 2
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern