Читать книгу Digital Communications 1 - Safwan El Assad - Страница 23
2.3.3. Properties of entropy
Оглавление– Positive: since 0 ≤ pi ≤ 1; (with the agreement
– Continuous: because it is a sum of continuous functions “log” of each pi.
– Symmetric: relative to all the variables pi.
– Upper bounded: entropy has a maximum value: got for a uniform law:
– Additive: let , then
[2.17]
