论文标题
Flipdyn:动态系统中的资源收购游戏
FlipDyn: A game of resource takeovers in dynamical systems
论文作者
论文摘要
我们介绍了一个游戏,其中两个具有反对目标的玩家试图反复收购共同的资源。该资源被建模为一个离散的时间动态系统,在每个时间步骤中花费州依赖的能量量后,玩家可以在其上获得控制。我们使用一个受夹具风格的确定性模型,该模型决定哪个时间步骤中哪个玩家在控制中。玩家的策略是玩家应在每个时间步骤中花费能量来获得控制的概率。我们的主要结果是三倍。首先,我们介绍了成本到go的分析表达式作为系统的混合状态的函数,即动态系统的物理状态和任何具有任意成本的通用系统的二进制\ texttt {flipdyn}状态。当物理状态也离散并且具有有限的基数时,这些表达式是准确的。其次,对于具有线性动力学和二次成本的连续物理状态,我们得出了NASH平衡(NE)的表达式。对于标量物理状态,我们表明NE仅取决于价值函数和成本的参数,并且独立于状态。第三,我们得出具有二次成本的更高维线性系统的近似值函数。最后,我们通过一项关于在对手存在下在给定环境中控制线性系统的问题的数值研究来说明结果。
We introduce a game in which two players with opposing objectives seek to repeatedly takeover a common resource. The resource is modeled as a discrete time dynamical system over which a player can gain control after spending a state-dependent amount of energy at each time step. We use a FlipIT-inspired deterministic model that decides which player is in control at every time step. A player's policy is the probability with which the player should spend energy to gain control at each time step. Our main results are three-fold. First, we present analytic expressions for the cost-to-go as a function of the hybrid state of the system, i.e., the physical state of the dynamical system and the binary \texttt{FlipDyn} state for any general system with arbitrary costs. These expressions are exact when the physical state is also discrete and has finite cardinality. Second, for a continuous physical state with linear dynamics and quadratic costs, we derive expressions for Nash equilibrium (NE). For scalar physical states, we show that the NE depends only on the parameters of the value function and costs, and is independent of the state. Third, we derive an approximate value function for higher dimensional linear systems with quadratic costs. Finally, we illustrate our results through a numerical study on the problem of controlling a linear system in a given environment in the presence of an adversary.