|title ||Information Theory & Coding|
|arbic title |
|credit hours ||3|
|Description/Outcomes ||Introduction to coding and information theory.|
|arabic Description/Outcomes |
|objectives ||Understand the key modules of digital communication system.
Understand encoders and decoders.
Understand the channel encoders and decoders.|
|arabic objectives |
|ref. books ||Simon Haykin ,"communication Systems", John Wiely and Sons, 2001|
|arabic ref. books |
|textbook ||T. M. Cover, ?Elements of Information Theory?, 2nd Ed Wiley-Interscience |
|arabic textbook |
|objective set ||bullets|
|content set ||bullets|
||Course outline and Review of probability theory
||Representation of probabilities in matrix form ? Concept of in information theory
||Average information & Entropy ? Joint Entropy and Conditional Entropy
||Self and Mutual information
||Maximum Entropy ? Channel capacity, Redundancy and efficiency.
||Channel capacity of some special channels ? time rate of information
||Simple derivation for Shannon?s formula for capacity , bandwidth and S/N of a channel + 7th week exam
||Channel BW versus S/N ratio trade off ? Elements of coding
||Efficiency of encoding process ? conditions for noiseless coding ? some encoding methods
||Shannon binary encoding method ? Shannon-Fano binary encoding method
||Block codes and maximum likelihood decoding ? Galois field arithmetic?s.
||Linear block codes + 12th Week exam
||Parity check codes - Error detection codes
||Different types of coding techniques.