TY - GEN
T1 - On the Selection of Strength for Fixed-Strength Interaction Coverage Based Prioritization
AU - Huang, Rubing
AU - Zong, Weiwen
AU - Chen, Tsong Yueh
AU - Towey, Dave
AU - Chen, Jinfu
AU - Zhou, Yunan
AU - Sun, Weifeng
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/6/8
Y1 - 2018/6/8
N2 - Test cases are derived by modeling the system under test, and have been widely applied in practice, such as for software product line testing, and combinatorial testing. Abstract test case prioritization (ATCP) is used to prioritize abstract test cases, and aims at achieving higher rates of fault detection. Many ATCP algorithms have been proposed, using different prioritization criteria and information. One ATCP approach makes use of fixed-strength level-combinations information covered by abstract test cases, and is called fixed-strength interaction coverage based prioritization (FICBP). Before using FICBP, the prioritization strength λ needs to be decided. Previous studies have generally focused on λ values ranging between 1 and 6. However, no study has investigated the appropriateness of such a range, nor how to assign the prioritization strength for FICBP. To answer these questions, this paper reports on an empirical study involving four real-life programs (each of which with six versions). The experimental results indicate that λ should be set approximately equal to a value corresponding to half of the number of parameters, when testing resources are sufficient. Our results also show that when testing resources are limited or insufficient, either small or large λ values are suggested for FICBP.
AB - Test cases are derived by modeling the system under test, and have been widely applied in practice, such as for software product line testing, and combinatorial testing. Abstract test case prioritization (ATCP) is used to prioritize abstract test cases, and aims at achieving higher rates of fault detection. Many ATCP algorithms have been proposed, using different prioritization criteria and information. One ATCP approach makes use of fixed-strength level-combinations information covered by abstract test cases, and is called fixed-strength interaction coverage based prioritization (FICBP). Before using FICBP, the prioritization strength λ needs to be decided. Previous studies have generally focused on λ values ranging between 1 and 6. However, no study has investigated the appropriateness of such a range, nor how to assign the prioritization strength for FICBP. To answer these questions, this paper reports on an empirical study involving four real-life programs (each of which with six versions). The experimental results indicate that λ should be set approximately equal to a value corresponding to half of the number of parameters, when testing resources are sufficient. Our results also show that when testing resources are limited or insufficient, either small or large λ values are suggested for FICBP.
KW - Abstract test case prioritization
KW - Empirical study
KW - FICBP
KW - Prioritization strength
KW - Software testing
UR - http://www.scopus.com/inward/record.url?scp=85055424128&partnerID=8YFLogxK
U2 - 10.1109/COMPSAC.2018.00049
DO - 10.1109/COMPSAC.2018.00049
M3 - Conference contribution
AN - SCOPUS:85055424128
T3 - Proceedings - International Computer Software and Applications Conference
SP - 310
EP - 315
BT - Proceedings - 2018 IEEE 42nd Annual Computer Software and Applications Conference, COMPSAC 2018
A2 - Lung, Chung-Horng
A2 - Conte, Thomas
A2 - Liu, Ling
A2 - Akiyama, Toyokazu
A2 - Hasan, Kamrul
A2 - Tovar, Edmundo
A2 - Takakura, Hiroki
A2 - Claycomb, William
A2 - Cimato, Stelvio
A2 - Yang, Ji-Jiang
A2 - Zhang, Zhiyong
A2 - Ahamed, Sheikh Iqbal
A2 - Reisman, Sorel
A2 - Demartini, Claudio
A2 - Nakamura, Motonori
PB - IEEE Computer Society
T2 - 42nd IEEE Computer Software and Applications Conference, COMPSAC 2018
Y2 - 23 July 2018 through 27 July 2018
ER -