23 lines
742 B
Markdown
23 lines
742 B
Markdown
Cours de Florent.
|
|
|
|
# Information Theory
|
|
|
|
## Coding theory
|
|
When we store or transmit data, no system is perfect and some bits of information are incorrectly stred/retrieved or transmitted.
|
|
|
|
The purpose of this field is to come up with coding and decoding methods that allows to detect and correct errors with a high probablilty.
|
|
|
|
We shall provide an introduction with simple codes.
|
|
|
|
## Topics covered on the board
|
|
|
|
* Binary symmetric channel
|
|
* Coding and decoding one bit to obtain arbitrary error
|
|
* example for a probability of error of 1/6
|
|
repeating 3 times, repeating 5 times.
|
|
|
|
This is essentially a practical version of Shannon's noisy-channel coding theorem.
|
|
|
|
[Details here](https://en.wikipedia.org/wiki/Binary_symmetric_channel)
|
|
|