论文标题
通过代码组合覆盖范围的回归测试案例优先级
Regression Test Case Prioritization by Code Combinations Coverage
论文作者
论文摘要
回归测试案例的优先级(RTCP)旨在通过尽早执行更重要的测试用例来提高故障检测率。已经根据不同的覆盖标准提出了各种RTCP技术。其中,大多数技术都利用代码覆盖信息来指导优先级的过程,并单独考虑代码单元。在本文中,我们提出了一个新的覆盖标准,即代码组合覆盖范围,该标准结合了代码覆盖范围和组合覆盖范围的概念。我们将此覆盖标准应用于RTCP,作为一种新的优先级技术,基于代码组合的优先级(CCCP)。我们报告了对CCCP的测试有效性和效率进行比较的经验研究与四种流行的RTCP技术的比较:总,额外的,自适应随机和基于搜索的测试优先级。实验结果表明,即使分配了最低的组合强度,总体而言,CCCP故障检测率也大于其他四种优先级技术的组合。还发现CCCP优先级成本与额外的测试优先级技术相媲美。此外,我们的结果还表明,当组合强度提高时,CCCP提供的故障检测率都比最先进的,无论代码覆盖范围如何。
Regression test case prioritization (RTCP) aims to improve the rate of fault detection by executing more important test cases as early as possible. Various RTCP techniques have been proposed based on different coverage criteria. Among them, a majority of techniques leverage code coverage information to guide the prioritization process, with code units being considered individually, and in isolation. In this paper, we propose a new coverage criterion, code combinations coverage, that combines the concepts of code coverage and combination coverage. We apply this coverage criterion to RTCP, as a new prioritization technique, code combinations coverage based prioritization (CCCP). We report on empirical studies conducted to compare the testing effectiveness and efficiency of CCCP with four popular RTCP techniques: total, additional, adaptive random, and search-based test prioritization. The experimental results show that even when the lowest combination strength is assigned, overall, the CCCP fault detection rates are greater than those of the other four prioritization techniques. The CCCP prioritization costs are also found to be comparable to the additional test prioritization technique. Moreover, our results also show that when the combination strength is increased, CCCP provides higher fault detection rates than the state-of-the-art, regardless of the levels of code coverage.