An Introduction to Information Theory

By Fazlollah M. Reza,

Book cover of An Introduction to Information Theory

Book description

Written for an engineering audience, this book has a threefold purpose: (1) to present elements of modern probability theory — discrete, continuous, and stochastic; (2) to present elements of information theory with emphasis on its basic roots in probability theory; and (3) to present elements of coding theory.
The emphasis…

Shepherd is reader supported. When you buy books, we may earn an affiliate commission.

Why read it?

1 author picked An Introduction to Information Theory as one of their favorite books. Why do they recommend it?

This is a more comprehensive and mathematically rigorous book than Pierce’s book. For the novice, it should be read-only after first reading Pierce’s more informal text. Due to its vintage, the layout is fairly cramped, but the content is impeccable. At almost 500 pages, it covers a huge amount of material. This was my main reference book on information theory for many years, but it now sits alongside more recent texts, like MacKay’s book (see below). It is also published by Dover, so it is reasonably priced.

From James' list on information theory.

Want books like An Introduction to Information Theory?

Our community of 10,000+ authors has personally recommended 32 books like An Introduction to Information Theory.

Browse books like An Introduction to Information Theory

5 book lists we think you will like!

Interested in information theory, probability, and math?

10,000+ authors have recommended their favorite books and what they love about them. Browse their picks for the best books about information theory, probability, and math.

Information Theory Explore 10 books about information theory
Probability Explore 18 books about probability
Math Explore 250 books about math