ELG 5170 Information Theory
3 units
Electrical Engineering
Faculty of Engineering
Measure of information: entropy, relative entropy, mutual information, asymptotic equipartition property, entropy rates for stochastic processes; Data compression: Huffman code, arithmetic coding; Channel capacity: random coding bound, reliability function, Blahut-Arimoto algorithm, Gaussian channels, colored Gaussian noise and "water-filling"; Rate distortion theory; Network information theory. This course is equivalent to EACJ 5501 at Carleton University.
Components:
Lecture
Previously Offered Terms:
Fall
Winter