Prioritization of combinatorial test cases by incremental interaction coverage

Rubing Huang, Xiaodong Xie, Dave Towey, Tsong Yueh Chen, Yansheng Lu, Jinfu Chen

Research output: Journal PublicationArticlepeer-review

19 Citations (Scopus)
3 Downloads (Pure)

Abstract

Combinatorial interaction testing is a well-recognized testing method, and has been widely applied in practice, often with the assumption that all test cases in a combinatorial test suite have the same fault detection capability. However, when testing resources are limited, an alternative assumption may be that some test cases are more likely to reveal failure, thus making the order of executing the test cases critical. To improve testing cost-effectiveness, prioritization of combinatorial test cases is employed. The most popular approach is based on interaction coverage, which prioritizes combinatorial test cases by repeatedly choosing an unexecuted test case that covers the largest number of uncovered parameter value combinations of a given strength (level of interaction among parameters). However, this approach suffers from some drawbacks. Based on previous observations that the majority of faults in practical systems can usually be triggered with parameter interactions of small strengths, we propose a new strategy of prioritizing combinatorial test cases by incrementally adjusting the strength values. Experimental results show that our method performs better than the random prioritization technique and the technique of prioritizing combinatorial test suites according to test case generation order, and has better performance than the interaction-coverage-based test prioritization technique in most cases.

Original languageEnglish
Pages (from-to)1427-1457
Number of pages31
JournalInternational Journal of Software Engineering and Knowledge Engineering
Volume23
Issue number10
DOIs
Publication statusPublished - Dec 2013

Keywords

  • Software testing
  • algorithm
  • combinatorial interaction testing
  • incremental interaction coverage
  • interaction coverage
  • test case prioritization

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications
  • Computer Graphics and Computer-Aided Design
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Prioritization of combinatorial test cases by incremental interaction coverage'. Together they form a unique fingerprint.

Cite this