Courses Detail Information
ECE6603J – Information Theory
Instructors:
Credits: 3 credits
Pre-requisites: Ve455 Introduction to Digital Communications and Coding or graduate standing.
Description:
This course introduces information theory, the mathematical theory of communications. This is primarily a theoretical course that gives insight into the fundamental limits of communication systems. Topics include the mathematical definition and properties of information, asymptotic equipartition principle, entropy rates of a stochastic process, data compression, channel capacity, differential entropy, Gaussian channel, and rate distortion theory.
Course Topics:
1. Introduction to Information Theory
2. Self Information, Entropy, Mutual Information
3. Asymptotic Equipartition Principle
4. Entropy Rate
5. Data Compression for Discrete Sources
6. Channel Capacity, Discrete Memoryless Channels
7. Differential Entropy
8. Gaussian Channels
9. Rate Distortion Theory