ELG 5170 Information Theory
3 units
Electrical Engineering
Faculty of Engineering
Measure of information: entropy, relative entropy, mutual information, asymptotic equipartition property, entropy rates for stochastic processes; Data compression: Huffman code, arithmetic coding; Channel capacity: random coding bound, reliability function, Blahut-Arimoto algorithm, Gaussian channels, colored Gaussian noise and "water-filling"; Rate distortion theory; Network information theory. This course is equivalent to EACJ 5501 at Carleton University.
Components:
Lecture
Previously Offered Terms:
Fall
Winter
Organized
6 responses
4.17
/ 5
Clear Expectations
6 responses
4.17
/ 5
Learned a Lot
6 responses
4.50
/ 5
Fair Assessments
6 responses