论文标题

从那里预期的自由能?

Whence the Expected Free Energy?

论文作者

Millidge, Beren, Tschantz, Alexander, Buckley, Christopher L

论文摘要

预期的自由能(EFE)是主动推断理论中的中心量。所有活性推理剂都被要求通过作用最小化的数量,并且将其分解为外在和内在的价值项是主动推理剂证明的探索和剥削平衡的关键。尽管它的重要性,但该数量的数学起源及其与变异自由能(VFE)的关系尚不清楚。在本文中,我们详细研究了EFE的起源,并表明这不仅仅是“将来的自由能”。我们提出了一种我们认为的功能,是VFE的自然扩展,但积极地阻止了探索性行为,因此表明勘探并不直接从自由能量最小化对未来。然后,我们建立了一个新颖的目标,即预期未来的自由能(FEEF),它既具有EFE的认知成分,又具有直观的数学基础,就像预测的未来和所需未来之间的差异一样。

The Expected Free Energy (EFE) is a central quantity in the theory of active inference. It is the quantity that all active inference agents are mandated to minimize through action, and its decomposition into extrinsic and intrinsic value terms is key to the balance of exploration and exploitation that active inference agents evince. Despite its importance, the mathematical origins of this quantity and its relation to the Variational Free Energy (VFE) remain unclear. In this paper, we investigate the origins of the EFE in detail and show that it is not simply "the free energy in the future". We present a functional that we argue is the natural extension of the VFE, but which actively discourages exploratory behaviour, thus demonstrating that exploration does not directly follow from free energy minimization into the future. We then develop a novel objective, the Free-Energy of the Expected Future (FEEF), which possesses both the epistemic component of the EFE as well as an intuitive mathematical grounding as the divergence between predicted and desired futures.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源