Gibbs algorithm =============== In statistical mechanics, the Gibbs algorithm, introduced by J. Willard Gibbs in 1902, is a criterion for choosing a probability distribution for the statistical ensemble of microstates of a thermodynamic system by minimizing the average log probability : \langle\ln p_i\rangle = \sum_i p_i \ln p_i \, subject to the probability distribution satisfying a set of constraints (usually expectation values) corresponding to the known macroscopic quantities. in 1948, Claude Shannon interpreted the negative of this quantity, which he called information entropy, as a measure of the uncertainty in a probability distribution. In 1957, E.T. Jaynes realized that this quantity could be interpreted as missing information about anything, and generalized the Gibbs algorithm to non-equilibrium systems with the principle of maximum entropy and maximum entropy thermodynamics. Physicists call the result of applying the Gibbs algorithm the Gibbs distribution for the given constraints, most notably Gibbs's grand canonical ensemble for open systems when the average energy and the average number of particles are given. (See also partition function). This general result of the Gibbs algorithm is then a maximum entropy probability distribution. Statisticians identify such distributions as belonging to exponential families. In statistical mechanics, the Gibbs algorithm, introduced by J. Willard Gibbs in 1902, is a criterion for choosing a probability distribution for the statistical ensemble of microstates of a thermodynamic system by minimizing the average log probability \langle\ln p_i\rangle = \sum_i p_i \ln p_i \, subject to the probability distribution satisfying a set of constraints (usually expectation values) corresponding to the known macroscopic quantities. in 1948, Claude Shannon interpreted the negative of this quantity, which he called information entropy, as a measure of the uncertainty in a probability distribution. In 1957, E.T. Jaynes realized that this quantity could be interpreted as missing information about anything, and generalized the Gibbs algorithm to non-equilibrium systems with the principle of maximum entropy and maximum entropy thermodynamics. Physicists call the result of applying the Gibbs algorithm the Gibbs distribution for the given constraints, most notably Gibbs's grand canonical ensemble for open systems when the average energy and the average number of particles are given. (See also partition function). This general result of the Gibbs algorithm is then a maximum entropy probability distribution. Statisticians identify such distributions as belonging to exponential families. ==References== REFERENCES ---------- BIBLIOGRAPHY (BibTeX) -------------------- @article{ref0, title = {Gibbs algorithm}, url = {https://encyclopegia.org/a/gibbs-algorithm} } BIBLIOGRAPHY (RIS) ------------------- TY - JOUR TI - Gibbs algorithm UR - https://encyclopegia.org/a/gibbs-algorithm ER - CITE THIS ARTICLE ---------------- Cite this article: Gibbs algorithm Derived from: https://en.wikipedia.org/w/index.php?oldid=1213449245 Licence: CC BY-SA 4.0 Snapshot: gibbs-algorithm-632247-c1d0ad73a44e5f4b Content hash: c1d0ad73a44e5f4ba479f7922b995d77b49a02c79927f9304223003b2ca2f7ac Permalink: /a/gibbs-algorithm