Tutorial: Communication

Main Menu Previous Topic Next Topic

** The Communication Tutorial **

Note: in order to run the dynamic simulations referred to in this tutorial, go here, to the Java Applet version. You will be directed to download the latest version of the Java plug-in.

This tutorial explores a formalization of information and communication as introduced by Claude Shannon in his 1948 master's thesis, “A Mathematical Theory of Communication” (The Bell System Technical Journal, Vol. 27, pp. 379-423, 623-656, July, October, 1948). This paper introduces entropy as a measure of information and proves Shannon's famous channel capacity theorem. This remarkable theorem initiated the modern field of information theory. In this tutorial, we provide some visual demonstrations of Shannon's ideas and summarize some of his results. Some contemporary perspective is taken from Elements of Information Theory by Thomas Cover and Joy Thomas (Donald Schilling, Ed. New York: John Wiley & Sons, Inc., 1991.)

**TABLE OF CONTENTS**

- Introduction
- Characterizing Messages
- Designing Encodings
- Closing Remarks
- Technical Appendix

Previous Slide Next Slide