Information Theory

Information theory is a mixture of applied statistics, computer science, and electrical engineering which is focused on the study of efficiency limits for processing information. Although information theory was originally developed to find fundamental limits on signal processing operations such as data compression and reliability of storing and communicating data, its application has expanded into diverse fields such as statistical inference, cryptography, neurobiology, molecular coding, model selection in ecology, thermal physics, quantum computation, plagiarism detection, and many others.

A course in information theory will most likely cover the following topics to the extent preferred by individual professors:

• Entropy, relative entropy, and mutual information
• The asymptotic equipartition property
• Entropy rates of stochastic processes
• Data compression
• Gambling
• Kolmogorov complexity
• Channel capacity
• Differential entropy
• Gaussian channels
• Spectral estimation
• Statistics
• Theory of rate distortion
• Networks
• The stock market
• Inequalities

To stay up to date, a terrific compilation of books and articles covering the theory and widespread application of information theory is available at Google scholar.

To fulfill our tutoring mission of online education, our college homework help and online tutoring centers are standing by 24/7, ready to assist college students who need homework help with all aspects of information theory. Our computer science tutors can help with all your projects, large or small, and we challenge you to find better online information theory tutoring anywhere.