mit  
 Department of Electrical Engineering and Computer Science
 Department of Mechanical Engineering
 6.050J / 2.110J     Information and Entropy     Spring 2005

Notes

Table of Contents

These notes are for the Spring 2005 offering, and will be placed here as revised during the semester.
Notes for earlier offerings are available also: Spring 2003 and Spring 2004.

Note that these notes are still under development. We would appreciate learning of any errors, and
would be pleased to receive suggestions for improvements. Please use the comment form linked below.

Preface (version 1.2)

Chapter 1. Bits (version 1.2)

Chapter 2. Codes (version 1.2)
  Transcribing RNA to Proteins

Chapter 3. Compression (version 1.2)

Chapter 4. Errors (version 1.2)

Chapter 5. Probability (version 1.2)

Chapter 6. Communications (version 1.2)

Chapter 7. Processes (version 1.2)

Chapter 8. Inference (version 1.2)

Chapter 9. Principle of Maximum Entropy (version 1.2)

Chapter 10. Physical Systems (version 1.2)

Chapter 11. Energy (version 1.2)

Chapter 12. Temperature (version 1.2)

Chapter 13. Quantum Information (version 1.2)

These notes are copyright © 2003, 2004, 2005 Massachusetts Institute of Technology


6.050J/2.110J home page | Spring 2005 | Site map | Search | About this page | Comments and inquiries