论文标题
在图形连续Lyapunov模型的拉索上
On the Lasso for Graphical Continuous Lyapunov Models
论文作者
论文摘要
图形连续的Lyapunov模型通过将每个独立观察结果视为一个时间过程的一次性横截面快照,为多元数据中的因果解释依赖性结构建模提供了新的观点。具体而言,这些模型假定观测值是平衡中独立多元Ornstein-uhlenbeck过程的横截面。高斯平衡在漂移矩阵上的稳定性假设下存在,并且平衡协方差矩阵由连续的Lyapunov方程确定。每个图形连续的Lyapunov模型都假设漂移矩阵稀疏,并由有向图确定的支撑。在这种情况下进行模型选择的一种自然方法是使用$ \ ell_1 $ regolarization技术,该技术基于给定的样本协方差矩阵,试图找到对Lyapunov方程的稀疏近似解决方案。我们研究了所得拉索技术的模型选择属性,以得出一致性结果。我们的详细分析表明,涉及的不明确性条件令人惊讶地难以满足。尽管这可能会阻止模型选择中的渐近一致性,但我们的数值实验表明,即使无法满足一致性的理论要求,LASSO方法也能够恢复漂移矩阵的相关结构,并且对模型错误指定的方面是可靠的。
Graphical continuous Lyapunov models offer a new perspective on modeling causally interpretable dependence structure in multivariate data by treating each independent observation as a one-time cross-sectional snapshot of a temporal process. Specifically, the models assume that the observations are cross-sections of independent multivariate Ornstein-Uhlenbeck processes in equilibrium. The Gaussian equilibrium exists under a stability assumption on the drift matrix, and the equilibrium covariance matrix is determined by the continuous Lyapunov equation. Each graphical continuous Lyapunov model assumes the drift matrix to be sparse, with a support determined by a directed graph. A natural approach to model selection in this setting is to use an $\ell_1$-regularization technique that, based on a given sample covariance matrix, seeks to find a sparse approximate solution to the Lyapunov equation. We study the model selection properties of the resulting lasso technique to arrive at a consistency result. Our detailed analysis reveals that the involved irrepresentability condition is surprisingly difficult to satisfy. While this may prevent asymptotic consistency in model selection, our numerical experiments indicate that even if the theoretical requirements for consistency are not met, the lasso approach is able to recover relevant structure of the drift matrix and is robust to aspects of model misspecification.