Information Theory in Computer Science
This note explains the following topics: Shearer's Lemma, Entropy, Relative Entropy, Hypothesis testing, total variation distance and Pinsker's lemma, Stability in Shearer's Lemma, Communication Complexity, Set Disjointness, Direct Sum in Communication Complexity and Internal Information Complexity, Data Structure Lower Bounds via Communication Complexity, Algorithmic Lovasz Local Lemma, Parallel Repetition Theorem, Graph Entropy and Sorting.
Author(s): Madhu Sudan
NA Pages 
Information Theory Inference and Learning Algorithms
This book contains below topics, Introduction to information theory, Probability, entropy, and inference, Source coding, Noisy channel coding, Sparse graph codes, Bayesian inference and Monte Carlo methods, Neural networks, Decision theory.
Author(s): David J. C. MacKay, University of Cambridge
640 Pages
An Introduction to Information Theory and Applications
This note explains the following topics, uncertainty and information, Efficient coding of information, Stationary processes and markov chains, Coding for noisy transmission, Complements to efficient coding of Information, Error correcting codes and cryptography.
Author(s): F Bavaud, J C Chappelier and J Kohlas
293 Pages
This book explains basics of thermodynamics, including thermodynamic potentials, microcanonical and canonical distributions, and evolution in the phase space, The inevitability of irreversibility, basics of information theory, applications of information theory, new second law of thermodynamics and quantum information.
Author(s): Gregory Falkovich
165 Pages
Information Theory Lecture Notes
This PDF covers the following topics related to Information Theory, Introduction, Entropy, Relative Entropy, and Mutual Information, Asymptotic Equipartition Properties, Communication and Channel Capacity, Method of Types, Conditional and Joint Typicality, Lossy Compression and Rate Distortion Theory, Joint Source Channel Coding.
Author(s): Prof. Tsachy Weissman
75 Pages
Information Theory for Data Communications and Processing
The PDF covers the following topics related to Information Theory, Information Theory for Data Communications and Processing, On the Information Bottleneck Problems, Models, Connections,Applications and Information Theoretic Views, Variational Information Bottleneck for Unsupervised Clustering, Deep Gaussian Mixture Embedding, Asymptotic RateDistortion Analysis of Symmetric Remote Gaussian Source Coding, Centralized Encoding vs. Distributed Encoding, NonOrthogonal eMBBURLLC Radio Access for Cloud Radio Access Networks with Analog Fronthauling, Robust Baseband Compression Against Congestion in PacketBased Fronthaul Networks Using Multiple Description Coding, Amplitude Constrained MIMO Channels, Properties of Optimal Input Distributions and Bounds on the Capacity, QuasiConcavity for Gaussian Multicast Relay Channels, Gaussian Multiple Access Channels with OneBit Quantizer at the Receiver, Efficient Algorithms for Coded Multicasting in Heterogeneous Caching Networks, CrossEntropy Method for Content Placement and User Association in CacheEnabled Coordinated UltraDense Networks, Symmetry, Outer Bounds, and Code Constructions, A ComputerAided Investigation on the Fundamental Limits of Caching.
Author(s): Shlomo Shamai, Abdellatif Zaidi
296 Pages
Information Theory and Coding cam
The PDF covers the following topics related to Information Theory, Foundations, probability, uncertainty, information, Entropies defined, and why they are measures of information, Source coding theorem, prefix, variable, and fixedlength codes, Channel types, properties, noise, and channel capacity, Continuous information, density, noisy channel coding theorem, Fourier series, convergence, orthogonal representation, Useful Fourier theorems, transform pairs, Sampling, aliasing, Discrete Fourier transform, Fast Fourier Transform Algorithms, The quantised degreesoffreedom in a continuous signal, GaborHeisenbergWeyl uncertainty relation, Kolmogorov complexity.
Author(s): J G Daugman
75 Pages
