Information Theory & Coding
6IT5-11 · Semester 6
0/37 topics
Objective of the course
Scope of the course
Outcome of the course
Uncertainty
Information
Entropy
Information measures for continuous random variables
Source coding theorem
Discrete memoryless channels
Mutual information
Conditional entropy
Prefix code
Huffman code
Shannon-Fano code
Lempel-Ziv coding
Channel capacity
Channel coding theorem
Shannon limit
Introduction to error-correcting codes
Coding of linear block code
Decoding of linear block code
Minimum distance considerations
Conversion of non-systematic matrices into systematic form
Code algebra
Basic properties of Galois Fields (GF)
Polynomial operations over Galois Fields
Generating cyclic code by generator polynomial
Parity check polynomial
Encoder for cyclic codes
Decoder for cyclic codes
Convolutional encoders of different rates
Code tree
Trellis diagram
State diagram
Maximum likelihood decoding of convolutional code
Viterbi algorithm
Free distance of a convolutional code