• Corpus ID: 210714080

A technical critique of the free energy principle as presented in "Life as we know it" and related works

@article{Biehl2020ATC,
  title={A technical critique of the free energy principle as presented in "Life as we know it" and related works},
  author={Martin Biehl and Felix A. Pollock and Ryota Kanai},
  journal={arXiv: Neurons and Cognition},
  year={2020}
}
We summarize the argument in Friston (2013, this https URL) and highlight some technical errors. We also discuss how these errors affect the very similar Friston (2014, this https URL) and, where appropriate, mention consequences for the newer proposals in Friston (2019, arXiv:1906.10184v1 ) and Parr et al. (2019, this https URL). The errors call into question the purported interpretation that the internal coordinates of every system with a Markov blanket will appear to engage in Bayesian… 

Figures from this paper

The Emperor's New Markov Blankets.
TLDR
This paper identifies a persistent confusion in the literature between the formal use of Markov blankets as an epistemic tool for Bayesian inference, and their novel metaphysical use in the free energy framework to demarcate the physical boundary between an agent and its environment.
The two kinds of free energy and the Bayesian revolution
TLDR
It is argued that there are essentially two different notions of free energy in current models of intelligent agency, that can both be considered as applications of Bayesian inference to the problem of action selection: one that appears when trading off accuracy and uncertainty based on a general maximum entropy principle, and one that formulates action selection in terms of minimizing an error measure.
A Mathematical Walkthrough and Discussion of the Free Energy Principle
TLDR
A mathematically detailed, yet intuitive walk-through of the formulation and central claims of the FEP is provided while also providing a discussion of the assumptions necessary and potential limitations of the theory.
On Bayesian Mechanics: A Physics of and by Beliefs
TLDR
The state of the art in the literature on the free energy principle is reviewed, distinguishing between three ways in which Bayesian mechanics has been applied to particular systems (i.e., path-tracking, mode- tracking, and mode-matching).
Causal blankets: Theory and algorithmic framework
TLDR
It is shown that every bipartite stochastic process has a causal blanket, but the extent to which this leads to an effective PALO formulation varies depending on the integrated information of the bipartition.
The Free Energy Principle: Good Science and Questionable Philosophy in a Grand Unifying Theory
TLDR
This paper accepts some of the abovementioned critiques, rejects the arguments advanced to invalidate the FEP’s potential to be a GUT, and overcomes criticism thereof by reviewing FEP theorists’ newly minted metaphysical commitment, namely MM.
Active Inference: First International Workshop, IWAI 2020, Co-located with ECML/PKDD 2020, Ghent, Belgium, September 14, 2020, Proceedings
TLDR
This work provides a formal comparison between Active Inference and Control-as-Inference and demonstrates that the primary difference arises from how the notion of rewards, goals, or desires is incorporated into their generative models.
Some Interesting Observations on the Free Energy Principle
TLDR
This discussion focuses on solenoidal coupling between various states in sparsely coupled systems that possess a Markov blanket - and the distinction between exact and approximate Bayesian inference, implied by the ensuing Bayesian mechanics.
An Integrated World Modeling Theory (IWMT) of Consciousness: Combining Integrated Information and Global Neuronal Workspace Theories With the Free Energy Principle and Active Inference Framework; Toward Solving the Hard Problem and Characterizing Agentic Causation
  • A. Safron
  • Biology
    Frontiers in Artificial Intelligence
  • 2020
TLDR
This work describes how streams of consciousness may emerge as an evolving generation of sensorimotor predictions, with the precise composition of experiences depending on the integration abilities of synchronous complexes as self-organizing harmonic modes (SOHMs).
The 2-D Cluster Variation Method: Topography Illustrations and Their Enthalpy Parameter Correlations
One of the biggest challenges in characterizing 2-D image topographies is finding a low-dimensional parameter set that can succinctly describe, not so much image patterns themselves, but the nature

References

SHOWING 1-10 OF 14 REFERENCES
Life as we know it
TLDR
A heuristic proof suggesting that life—or biological self-organization—is an inevitable and emergent property of any (ergodic) random dynamical system that possesses a Markov blanket is presented.
Markov blankets, information geometry and stochastic thermodynamics
TLDR
There is a natural Bayesian mechanics for any system that possesses a Markov blanket, which means that there is an explicit link between the inference performed by internal states and their energetics—as characterized by their stochastic thermodynamics.
A free energy principle for a particular physics
TLDR
The main contribution is to examine the implications of Markov blankets for self-organisation to nonequilibrium steady-state and recover an information geometry and accompanying free energy principle that allows one to interpret the internal states of something as representing or making inferences about its external states.
Cognitive Dynamics: From Attractors to Active Inference
TLDR
This paper combines recent formulations of self-organization and neuronal processing to provide an account of cognitive dynamics from basic principles and applies the emergent dynamics to action and perception in a way that casts action as the fulfillment of (Bayesian) beliefs about the causes of sensations.
Active inference and epistemic value
TLDR
A formal treatment of choice behavior based on the premise that agents minimize the expected free energy of future outcomes and ad hoc softmax parameters become the expected (Bayes-optimal) precision of beliefs about, or confidence in, policies.
LETTER TO THE EDITOR: Potential in stochastic differential equations: novel construction
TLDR
It is demonstrated that a dynamical structure built into stochastic differential equation allows for a global optimization potential function and an explicit construction procedure is presented to obtain the potential and relevant quantities.
Structure of stochastic dynamics near fixed points.
  • C. Kwon, P. Ao, D. Thouless
  • Physics
    Proceedings of the National Academy of Sciences of the United States of America
  • 2005
We analyze the structure of stochastic dynamics near either a stable or unstable fixed point, where the force can be approximated by linearization. We find that a cost function that determines a
Nonequilibrium steady state of a stochastic system driven by a nonlinear drift force.
  • C. Kwon, P. Ao
  • Physics
    Physical review. E, Statistical, nonlinear, and soft matter physics
  • 2011
TLDR
An interesting potential landscape picture is found where the probability maximum shifts from the fixed point of the drift force and the NESS current has a nontrivial circulation that flows off the equiprobability surface and has various centers not located at the probabilitymaximum.
What is ergodic theory
Ergodic theory involves the study of transformations on measure spaces. Interchanging the words “measurable function” and “probability density function” translates many results from real analysis to
Stochastic processes in physics and chemistry
Preface to the first edition. Preface to the second edition. Abbreviated references. I. Stochastic variables. II. Random events. III. Stochastic processes. IV. Markov processes. V. The master
...
...