Information Theory
Information theory is a mixture of applied statistics, computer science, and electrical engineering which is focused on the study of efficiency limits for processing information. Although information theory was originally developed to find fundamental limits on signal processing operations such as data compression and reliability of storing and communicating data, its application has expanded into diverse fields like statistical inference, language processing, cryptography, neurobiology, molecular coding, model selection in ecology, thermal physics, quantum computation, plagiarism detection, and many others.
A course in information theory will most likely cover the following topics to the extent preferred by individual professors:
- entropy, relative entropy, and mutual information
- the asymptotic equipartition property
- entropy rates of stochastic processes
- data compression
- gambling
- kolmogorov complexity
- channel capacity
- differential entropy
- gaussian channels
- spectral estimation
- statistics
- theory of rate distortion
- networks
- the stock market
- inequalities
To stay up to date, a terrific compilation of books and articles covering the theory and widespread application of information theory is available at Google scholar.
To fulfill our mission of educating students, our homework help and online tutoring centers are standing by 24/7, ready to assist students who need help with information theory.
|
| Subjects & Resources |
- Administration
- Anthropology
- Architecture
- Business
- Computer Science
- 3D Graphics
- Artificial Intelligence
- Circuit Analysis
- Cryptography
- Data Structures and Algorithms
- Database Development
- Digital Electronics
- Discrete Math
- Image Processing
- Information Security
- Information Theory
- Linux (Shell Scripting, etc.)
- Matlab
- Networks Management
- Parallel Computing
- Programming (Assembly Language)
- Programming (C Family)
- Programming (Dynamic, Linear, Non-linear, etc.)
- Programming (Java)
- Programming (Python, Perl, Ruby, etc.)
- Software Engineering/Design
- Software Testing/Analysis
- Software Training (Excel, Word, PowerPoint, etc.)
- Systems Architecture
- Theoretical
- Verilog HDL
- Web Design (HTML, XML, PHP, Adobe, Flash, etc.)
- Engineering
- Exam Prep
- Geography
- Government and Politics
- High School Subjects
- History
- Language
- Law
- Math
- Media Studies
- Medicine
- Music
- Philosophy
- Physical Sciences
- Psychology
- Public Speaking
- Religion
- Sociology
- Sports Science (P.E.)
- Theater
- Writing
|
|
|
REQUEST LIVE SESSION
CLOSE
