variational free energy
An information-theoretic quantity that upper-bounds surprise (negative log model evidence); minimizing it approximates Bayesian inference. Formally identical to thermodynamic free energy minus Boltzmann's constant.
As defined in 87 | Karl Friston on Brains, Predictions, and Free Energy
Where it comes up · 1
Most important claims · 3 of 3Search all claims for “variational free energy” →
- The variational free energy is formally identical to the Gibbs/thermodynamic free energy equation; the only difference is dropping Boltzmann's constant from the Shannon entropy term, so the information-theoretic and thermodynamic free energies are the same equation operating on different objects.87 | Karl Friston on Brains, Predictions, and Free Energy
- Variational free energy is a statistical, information-theoretic quantity defined only relative to a generative model; it provides an upper bound on surprise (the negative log of model evidence / marginal likelihood), so minimizing it makes a system appear to be maximizing the evidence for its own model of the world.87 | Karl Friston on Brains, Predictions, and Free Energy
- Viewed through a statistician's lens, the brain is a statistical organ—a little scientist inside the head—that, by minimizing variational free energy, behaves as though it is maximizing the evidence for its own model of the world.87 | Karl Friston on Brains, Predictions, and Free Energy