publicMasters/1InformationTheory.md

742 B

Cours de Florent.

Information Theory

Coding theory

When we store or transmit data, no system is perfect and some bits of information are incorrectly stred/retrieved or transmitted.

The purpose of this field is to come up with coding and decoding methods that allows to detect and correct errors with a high probablilty.

We shall provide an introduction with simple codes.

Topics covered on the board

  • Binary symmetric channel
  • Coding and decoding one bit to obtain arbitrary error
  • example for a probability of error of 1/6 repeating 3 times, repeating 5 times.

This is essentially a practical version of Shannon's noisy-channel coding theorem.

Details here