Information theory is a mixture of applied statistics, computer science, and electrical engineering which is focused on the study of efficiency limits for processing information. Although information theory was originally developed to find fundamental limits on signal processing operations such as data compression and reliability of storing and communicating data, its application has expanded into diverse fields such as statistical inference, cryptography, neurobiology, molecular coding, model selection in ecology, thermal physics, quantum computation, plagiarism detection, and many others.
A course in information theory will most likely cover the following topics to the extent preferred by individual professors:
To stay up to date, a terrific compilation of books and articles covering the theory and widespread application of information theory is available at Google scholar.
Are you sure you don't want to upload any files?
Fast tutor response requires as much info as possible.