Complexity Explorer Santa Few Institute

Maximum Entropy Methods

Lead instructor:

Your progress is not being saved! Enroll now or log in to track your progress or submit homework.

2.1 A Simple Example: Waiting for a Taxicab » Quiz 2 Solution

1) The answer is c.  Use -∑p log(p) where log is the natural logarithm.  We have - 1 log(1) + -0 log(0) = - log(1) = 0.

2) The answer is b. We have - .5 log(.5) + -.5 log(.5) = - log(.5) = 0.693.