Restricted random testing: Adaptive random testing by exclusion

Kwok Ping Chan, Tsong Yueh Chen, Dave Towey

Research output: Journal PublicationArticlepeer-review

71 Citations (Scopus)

Abstract

Restricted Random Testing (RRT) is a new method of testing software that improves upon traditional Random Testing (RT) techniques. Research has indicated that failure patterns (portions of an input domain which, when executed, cause the program to fail or reveal an error) can influence the effectiveness of testing strategies. For certain types of failure patterns, it has been found that a widespread and even distribution of test cases in the input domain can be significantly more effective at detecting failure compared with ordinary RT. Testing methods based on RT, but which aim to achieve even and widespread distributions, have been called Adaptive Random Testing (ART) strategies. One implementation of ART is RRT. RRT uses exclusion zones around executed, but non-failure-causing, test cases to restrict the regions of the input domain from which subsequent test cases may be drawn. In this paper, we introduce the motivation behind RRT, explain the algorithm and detail some empirical analyses carried out to examine the effectiveness of the method. Two versions of RRT are presented: Ordinary RRT (ORRT) and Normalized RRT (NRRT). The two versions share the same fundamental algorithm, but differ in their treatment of non-homogeneous input domains. Investigations into the use of alternative exclusion shapes are outlined, and a simple technique for reducing the computational overheads of RRT, prompted by the alternative exclusion shape investigations, is also explained. The performance of RRT is compared with RT and another ART method based on maximized minimum test case separation (DART), showing excellent improvement over RT and a very favorable comparison with DART.

Original languageEnglish
Pages (from-to)553-584
Number of pages32
JournalInternational Journal of Software Engineering and Knowledge Engineering
Volume16
Issue number4
DOIs
Publication statusPublished - Aug 2006
Externally publishedYes

Keywords

  • Adaptive random testing
  • Random testing
  • Restricted random testing
  • Software testing

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications
  • Computer Graphics and Computer-Aided Design
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Restricted random testing: Adaptive random testing by exclusion'. Together they form a unique fingerprint.

Cite this