论文标题
双级多级支持向量机的解决方案路径算法
Solution Path Algorithm for Twin Multi-class Support Vector Machine
论文作者
论文摘要
双支持向量机及其扩展在处理二进制分类问题方面取得了巨大的成就。但是,它在有效解决多分类和快速模型选择方面遇到了困难。这项工作专门用于双级支持向量机的快速正则参数调整算法。具体而言,首先采用了一种新型的样本数据集分区策略,这是模型构建的基础。然后,结合线性方程和块矩阵理论,Lagrangian乘数被证明是分段线性W.R.T.正则化参数,因此仅通过求解断点来连续更新正则化参数。接下来,随着正规化参数接近无穷大的无限,拉格朗日乘数被证明是1,因此,设计了一种简单而有效的初始化算法。最后,定义了八种事件,以寻求下一次迭代的起始事件。对九个UCI数据集的广泛实验结果表明,所提出的方法可以实现可比的分类性能,而无需解决任何二次编程问题。
The twin support vector machine and its extensions have made great achievements in dealing with binary classification problems. However, it suffers from difficulties in effective solution of multi-classification and fast model selection. This work devotes to the fast regularization parameter tuning algorithm for the twin multi-class support vector machine. Specifically, a novel sample data set partition strategy is first adopted, which is the basis for the model construction. Then, combining the linear equations and block matrix theory, the Lagrangian multipliers are proved to be piecewise linear w.r.t. the regularization parameters, so that the regularization parameters are continuously updated by only solving the break points. Next, Lagrangian multipliers are proved to be 1 as the regularization parameter approaches infinity, thus, a simple yet effective initialization algorithm is devised. Finally, eight kinds of events are defined to seek for the starting event for the next iteration. Extensive experimental results on nine UCI data sets show that the proposed method can achieve comparable classification performance without solving any quadratic programming problem.