Week 1: Introduction: Entropy, Relative Entropy, Mutual Information;
Week 2: Block to variable length coding-I: Prefix-free code
Block to variable length coding-II: Bounds on optimal codelength;
Block to variable length coding-III: Huffman coding.
Week 3: Variable to block length coding
The asymptotic equipartition property
Block to block coding of DMS
Week 4: Universal Source Coding-I: Lempel-Ziv Algorithm-LZ77
Universal source coding-II: Lempel-Ziv Welch Algorithm (LZW)
Week 5: Coding for sources with memory
Channel capacity of discrete memoryless channels.
Week 6: Joint typical sequences
Noisy channel coding theorem;
Week 7: Gaussian Channel;
Parallel Gaussian Channel.
Week 8: Rate Distortion Theory;
Blahut-Arimoto Algorithm for computation of channel capacity and rate- distortion function.