Complexity Explorer Santa Fe Institute


principle of maximum entropy

The principle of maximum entropy states is based on the premise that when estimating the probability distribution, one should select that distribution which leaves the largest remaining uncertainty (i.e., the maximum entropy) consistent with the constraints. That way, no additional assumptions or biases have been introduced into the calculations.


Topics
Statistics, Entropy, Information Theory
Difficulty
1