ELEC 321

Tutorial 9

Updated 2017-12-11

The entropy of the uniform distribution is largest. The entropy of a uniform distribution is given as:

To show that the entropy of the uniform distribution is greater than the entropy of any other function, consider

Source Coding Theorem