An Introduction to Information Theory

By Fazlollah M. Reza,

Book cover of An Introduction to Information Theory

Book description

Written for an engineering audience, this book has a threefold purpose: (1) to present elements of modern probability theory — discrete, continuous, and stochastic; (2) to present elements of information theory with emphasis on its basic roots in probability theory; and (3) to present elements of coding theory.
The emphasis…

When you buy books, we may earn a commission that helps keep our lights on (or join the rebellion as a member).

Why read it?

1 author picked An Introduction to Information Theory as one of their favorite books. Why do they recommend it?

This is a more comprehensive and mathematically rigorous book than Pierce’s book. For the novice, it should be read-only after first reading Pierce’s more informal text. Due to its vintage, the layout is fairly cramped, but the content is impeccable. At almost 500 pages, it covers a huge amount of material. This was my main reference book on information theory for many years, but it now sits alongside more recent texts, like MacKay’s book (see below). It is also published by Dover, so it is reasonably priced.

From James' list on information theory.

Want books like An Introduction to Information Theory?

Our community of 12,000+ authors has personally recommended 35 books like An Introduction to Information Theory.

Browse books like An Introduction to Information Theory

Book cover of Introduction to Information Theory: Symbols, Signals and Noise
Book cover of Elements of Information Theory
Book cover of Information Theory, Inference and Learning Algorithms

Share your top 3 reads of 2024!

And get a beautiful page showing off your 3 favorite reads.

1,187

readers submitted
so far, will you?

5 book lists we think you will like!

Interested in information theory, probability, and math?

Probability 21 books
Math 276 books