# Information Theory

@article{Goddard1962InformationT, title={Information Theory}, author={L. S. Goddard}, journal={Nature}, year={1962}, volume={196}, pages={205-206} }

Information TheoryPapers read at a Symposium on Information Theory held at the Royal Institution, London, August 29th to September 2nd, 1960. Edited by Colin Cherry. Pp. xi + 476. (London: Butterworth and Co. (Publishers), Ltd., 1961.) 95s.

## 3,151 Citations

Information Theory: A Tutorial Introduction

- Computer ScienceArXiv
- 2018

This paper is an informal but rigorous introduction to the main ideas implicit in Shannon's theory and an annotated reading list is provided for further reading.

ON THE INEQUALITIES IN INFORMATION THEORY

- Computer Science
- 2007

The field of Information Theory grew with researchers finding more results and insights into the fundamental problem of transmission of and storage using probabilistic models, and Raymond Yeung’s framework thus enabled to verify all the Shannon type inequalities.

A Rosetta Stone for information theory and differential equations

- Computer Science, MathematicsCommunications in Advanced Mathematical Sciences
- 2018

This paper proposes a dictionary between Partial Differential Equations and Information Theory and discusses in detail the example of the Schrodinger Equation and Shannon Information Theory.

Multisource information theory

- Computer Science
- 2005

This article tries to develop its algorithmic information theory counterpart and use it as the general framework for many interesting questions about Kolmogorov complexity.

An algebraic approach to information theory

- Computer Science, Mathematics2010 IEEE International Symposium on Information Theory
- 2010

An algebraic model of probability theory is given and several important theorems of classical probability and information theory are presented in the algebraic framework.

Information theory related learning

- Computer ScienceESANN
- 2011

This is the introduction paper to a special session held on ESANN conference 2011. It reviews and highlights recent developments and new direction in information related learning, which is af astly…

Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory

- Computer ScienceEntropy
- 2001

Basic concepts and results of that part of Information Theory which is often referred to as "Shannon Theory" are discussed with focus mainly on the discrete case. The paper is expository with some…

Fifty Years of Shannon Theory

- Computer ScienceIEEE Trans. Inf. Theory
- 1998

A brief chronicle is given of the historical development of the central problems in the theory of fundamental limits of data compression and reliable communication.

Efficient Markets Meet the Shannon Limit (The Shannon Limit, Relative Channel Capacity, and Price Uncertainty)

- Economics
- 2014

A central concept of this paper is that information theory could help illuminate an important additional source of uncertainty in finance and economics. The communication constraints dictated by…

Lecture notes on descriptional complexity and randomness

- PsychologyArXiv
- 2021

A didactical survey of the foundations of Algorithmic Information Theory. These notes are short on motivation, history and background but introduce some of the main techniques and concepts of the…