Redundancy (information theory)

In information theory, redundancy (redundation) measures the fractional difference between the entropy H(X) of an ensemble X, and its maximum possible value log ⁡ ( | A X | ) {\displaystyle \log(|{\mathcal {A}}_{X}|)} . Informally, it is the amount of wasted "space" used to transmit certain data.