content serial 
describtion 
1 
Course outline and Review of probability theory

2 
Representation of probabilities in matrix form ? Concept of in information theory

3 
Average information & Entropy ? Joint Entropy and Conditional Entropy

4 
Self and Mutual information

5 
Maximum Entropy ? Channel capacity, Redundancy and efficiency.

6 
Channel capacity of some special channels ? time rate of information

7 
Simple derivation for Shannon?s formula for capacity , bandwidth and S/N of a channel + 7th week exam

8 
Channel BW versus S/N ratio trade off ? Elements of coding

9 
Efficiency of encoding process ? conditions for noiseless coding ? some encoding methods

10 
Shannon binary encoding method ? ShannonFano binary encoding method

11 
Block codes and maximum likelihood decoding ? Galois field arithmetic?s.

12 
Linear block codes + 12th Week exam

13 
Parity check codes  Error detection codes

14 
Cyclic codes.

15 
Different types of coding techniques.

16 
Final Examination
