UE Coding and information theory

Degrees incorporating this pedagocial element :


Information theory provides a quantitative measurement of the information provided by a message or observation. This concept was introduced by Claude Shannon in 1948 to establish the limits of what is possible in terms of data compression and transmission over noisy channels. Since then, this theory has found many applications in telecommunications, IT and statistics. The main themes addressed are:

  • Introduction to transmission systems (SNR, BER, etc.), concept of noise.
  • Entropy.
  • Source coding, channel coding, error-correcting code (Hamming, etc.).
  • Digitisation, quantisation noise and non-linear coding (the A-law).