Complexity Explorer Santa Fe Institute

Introduction to Information Theory

Lead instructor: Seth Lloyd

Your progress is not being saved! Enroll now or log in to track your progress or submit homework.

8.1 Shannon's Coding Theorem » Quiz

Quiz scores are NOT recorded.

  • You may come back to quizzes and take them as many times as you like
  • When you are finished, clicking the "Score" button at the bottom of the test will show you the correct responses.

Question 1

Shannon’s Noisy Channel Coding Theorem states that the maximal rate at which a sender can send information to a receiver across a channel is determined by

Question 2

Alice wants to send communicate messages to Bob. Alice can send one of 100 possible messages, but we don’t know the distribution according to which Alice will choose the different messages. In the worst case, what is the minimum channel capacity needed for Alice to communicate with Bob with vanishing error rates?