These notes provide a
graduate-level introduction to the mathematics of Information Theory. Topics covered includes:
Information measures: entropy, divergence and mutual information, Sufficient
statistic, Extremization of mutual information, Lossless data compression,
Channel coding, Linear codes, Lossy data compression, Applications to
statistical decision theory, Multiple-access channel, Entropy method in
combinatorics and geometry.