Complexity Explorer Santa Fe Institute

principle of maximum entropy

The principle of maximum entropy states is based on the premise that when estimating the probability distribution, one should select that distribution which leaves the largest remaining uncertainty (i.e., the maximum entropy) consistent with the constraints. That way, no additional assumptions or biases have been introduced into the calculations.

Statistics, Entropy, Information Theory