×
Loading...

Mathematical Foundations Of Information Theory by A. Ya. Khinchin

Book Information

TitleMathematical Foundations Of Information Theory
CreatorA. Ya. Khinchin
Year1957
PPI300
LanguageEnglish
Mediatypetexts
Subjectmathematics, information, noise, entropy, uniqueness theorem, markov chains, coding theory, shanon's inequality, feinstein inequality, ergodic theory, ergodic sources, concept of channel, feinstein fundamental lemma, shanon's theorems
Collectionmir-titles, additional_collections
Uploadermirtitles
Identifierkhinchin-mathematical-foundations-of-information-theory
Telegram icon Share on Telegram
Download Now

Description

The book is a translation of two papers written by the Russian mathematician, A. I. Khinchin, for the expository journal Uspekhi. These papers present the mathematical foundations of information theory. While completely rigorous, the flavour of the engineering applications which led to the theory runs throughout and very much helps the intuition. Khinchin has here reformulated basic concepts and presents for the first time rigorous proofs of certain fundamental theorems in the subject.The first paper discusses the concept of entropy and gives one major application to coding. The only stochastic processes used are Markov chains. This paper would serve as a valuable supplement to an introductory probability course.The second and longer paper uses more advanced topics from probability theory, for example, stationary processes and martingales. However, the treatment is quite complete and the non specialist would not suffer thanks to Khinchin's amazing expository ability.It is a tribute to Shannon's theory that a rigorous treatment only enhancesthe elegance of the basic theorems.