6.441 | Spring 2016 | Graduate

Information Theory

Course Description

This is a graduate-level introduction to mathematics of information theory. We will cover both classical and modern topics, including information entropy, lossless data compression, binary hypothesis testing, channel coding, and lossy data compression.
Learning Resource Types
Problem Sets
Lecture Notes
A series of manila folders in a filing cabinet. One is prominently labeled "Information Theory".
Information Theory is the study of the transmission of information, including fundamental transmission limits, optimal encoding, and error correction. (Photo courtesy of Suzanne Chapman, CC-BY-NC-SA)