Читать книгу Digital Communications 1 - Safwan El Assad - Страница 29
2.5.2. Relations between the various entropies
ОглавлениеWe can write:
In the same way, as one has: H(Y, X) = H(X, Y), therefore:
In addition, one has the following inequalities:
[2.38]
and similarly:
[2.39]
SPECIAL CASES.–
– Noiseless channel: in this case, on receipt of yj, there is certainty about the symbol actually transmitted, called xi (one-to-one correspondence), therefore:
[2.40]
Consequently:
[2.41]
and:
[2.42]
– Channel with maximum power noise: in this case, the variable at the input is independent of that of the output, i.e.:
[2.43]
We then have:
[2.44]
[2.45]
[2.46]
Note.– In information security, if xi is the plaintext, and yj is the corresponding ciphertext, then p(xi/yi) = p(xi) is the condition of the perfect secret of a cryptosystem.