Dynamic Random Testing of Web Services: A Methodology and Evaluation

Chang Ai Sun, Hepeng Dai, Guan Wang, Dave Towey, Tsong Yueh Chen, Kai Yuan Cai

Research output: Journal PublicationArticlepeer-review

7 Citations (Scopus)
38 Downloads (Pure)


In recent years, service oriented architecture (SOA) has been increasingly adopted to develop distributed applications in the context of the Internet. To develop reliable SOA-based applications, an important issue is how to ensure the quality of web services. In this article, we propose a dynamic random testing (DRT) technique for web services, which is an improvement over the widely-practiced random testing (RT) and partition testing (PT) approaches. We examine key issues when adapting DRT to the context of SOA, including a framework, guidelines for parameter settings, and a prototype for such an adaptation. Empirical studies are reported where DRT is used to test three real-life web services, and mutation analysis is employed to measure the effectiveness. Our experimental results show that, compared with the three baseline techniques, RT, Adaptive Testing (AT) and Random Partition Testing (RPT), DRT demonstrates higher fault-detection effectiveness with a lower test case selection overhead. Furthermore, the theoretical guidelines of parameter setting for DRT are confirmed to be effective. The proposed DRT and the prototype provide an effective and efficient approach for testing web services.

Original languageEnglish
Pages (from-to)736-751
Number of pages16
JournalIEEE Transactions on Services Computing
Issue number2
Publication statusPublished - 18 Dec 2019


  • Software testing
  • dynamic random testing
  • random testing
  • service oriented architecture
  • software cybernetics
  • web service

ASJC Scopus subject areas

  • Hardware and Architecture
  • Computer Science Applications
  • Computer Networks and Communications
  • Information Systems and Management


Dive into the research topics of 'Dynamic Random Testing of Web Services: A Methodology and Evaluation'. Together they form a unique fingerprint.

Cite this