Tuesday, July 12, 2011

Information on the Information Theory

After talking about the Information theory in class, I was still a little confused - it was an information overload for me. So I found this article The Basics of Information Theory by David Touetzky at Carnegie Melon to try to fill in what went a little over my head in class. He does a pretty good job of explaining the Variable Length Codes we talked about and uses the example of flipping a coin to explain the theory:

Because there are only two sides of a coin (a fair coin), there are only 2 possible outcomes when you flip it. So each flip requires 1 bit of information to transmit.

Just a helpful external link to check out if your head was spinning after yesterday's class.

No comments:

Post a Comment