Metamorphic Testing of Mapping Software

Joshua Brown; Zhi Quan Zhou; Yang Wai Chow

doi:10.1007/978-3-030-28430-5_1

Metamorphic Testing of Mapping Software

Joshua Brown
, Zhi Quan Zhou^*
, Yang Wai Chow

^*Corresponding author for this work

Research output: Chapter in Book/Conference proceeding › Conference contribution › peer-review

5 Citations (Scopus)

Abstract

Mapping software is difficult to test because it is very costly to evaluate its output. This difficulty is generally known as the oracle problem, a fundamental challenge in software testing. In this paper, we propose a metamorphic testing strategy to alleviate the oracle problem in testing mapping software. We first conduct a case study to test Google Maps, the most popular web mapping service. The results of the case study show that our testing approach is effective, with the detection of several real-life bugs that can hardly be exposed under conventional testing paradigms. Following this, we conduct an analysis of the system OpenStreetMap, well-known open-source mapping software built and maintained by a community of users. We show the potential of metamorphic testing for such systems. These case studies show that metamorphic testing can be applied to mapping software for both verification and validation purposes.

Original language	English
Title of host publication	Towards Integrated Web, Mobile, and IoT Technology - Selected and Revised Papers from the Web Technologies Track at SAC 2017 and SAC 2018, and the Software Development for Mobile Devices, Wearables, and the IoT Minitrack at HICSS 2018
Editors	Tim A. Majchrzak, Cristian Mateos, Francesco Poggi, Tor-Morten Grønli
Publisher	Springer Verlag
Pages	1-20
Number of pages	20
ISBN (Print)	9783030284299
DOIs	https://doi.org/10.1007/978-3-030-28430-5_1
Publication status	Published - 2019
Externally published	Yes
Event	Web Technologies track at the 32rd ACM/SIGAPP Symposium On Applied Computing, SAC 2017, Web Technologies track at the 33nd ACM/SIGAPP Symposium On Applied Computing, SAC 2018 and oftware Development for Mobile Devices, Wearables, and the Internet-of-Things Minitrack at the 51st Hawaii International Conference on System Sciences, HICSS 2018 - Pau, France Duration: 9 Apr 2018 → 13 Apr 2018

Publication series

Name	Lecture Notes in Business Information Processing
Volume	347
ISSN (Print)	1865-1348
ISSN (Electronic)	1865-1356

Conference

Conference	Web Technologies track at the 32rd ACM/SIGAPP Symposium On Applied Computing, SAC 2017, Web Technologies track at the 33nd ACM/SIGAPP Symposium On Applied Computing, SAC 2018 and oftware Development for Mobile Devices, Wearables, and the Internet-of-Things Minitrack at the 51st Hawaii International Conference on System Sciences, HICSS 2018
Country/Territory	France
City	Pau
Period	9/04/18 → 13/04/18

Free Keywords

Google Maps
Graphical User Interface
Mapping software
Metamorphic testing
Navigation software
OpenStreetMap
Oracle problem
Software testing
Web service

ASJC Scopus subject areas

Control and Systems Engineering
Management Information Systems
Business and International Management
Information Systems
Modelling and Simulation
Information Systems and Management

Access to Document

10.1007/978-3-030-28430-5_1

Cite this

Brown, J., Zhou, Z. Q., & Chow, Y. W. (2019). Metamorphic Testing of Mapping Software. In T. A. Majchrzak, C. Mateos, F. Poggi, & T.-M. Grønli (Eds.), Towards Integrated Web, Mobile, and IoT Technology - Selected and Revised Papers from the Web Technologies Track at SAC 2017 and SAC 2018, and the Software Development for Mobile Devices, Wearables, and the IoT Minitrack at HICSS 2018 (pp. 1-20). (Lecture Notes in Business Information Processing; Vol. 347). Springer Verlag. https://doi.org/10.1007/978-3-030-28430-5_1

Brown, Joshua ; Zhou, Zhi Quan ; Chow, Yang Wai. / Metamorphic Testing of Mapping Software. Towards Integrated Web, Mobile, and IoT Technology - Selected and Revised Papers from the Web Technologies Track at SAC 2017 and SAC 2018, and the Software Development for Mobile Devices, Wearables, and the IoT Minitrack at HICSS 2018. editor / Tim A. Majchrzak ; Cristian Mateos ; Francesco Poggi ; Tor-Morten Grønli. Springer Verlag, 2019. pp. 1-20 (Lecture Notes in Business Information Processing).

@inproceedings{ac1416f0702447ebac186222d32b97cc,

title = "Metamorphic Testing of Mapping Software",

abstract = "Mapping software is difficult to test because it is very costly to evaluate its output. This difficulty is generally known as the oracle problem, a fundamental challenge in software testing. In this paper, we propose a metamorphic testing strategy to alleviate the oracle problem in testing mapping software. We first conduct a case study to test Google Maps, the most popular web mapping service. The results of the case study show that our testing approach is effective, with the detection of several real-life bugs that can hardly be exposed under conventional testing paradigms. Following this, we conduct an analysis of the system OpenStreetMap, well-known open-source mapping software built and maintained by a community of users. We show the potential of metamorphic testing for such systems. These case studies show that metamorphic testing can be applied to mapping software for both verification and validation purposes.",

keywords = "Google Maps, Graphical User Interface, Mapping software, Metamorphic testing, Navigation software, OpenStreetMap, Oracle problem, Software testing, Web service",

author = "Joshua Brown and Zhou, \{Zhi Quan\} and Chow, \{Yang Wai\}",

note = "Publisher Copyright: {\textcopyright} Springer Nature Switzerland AG 2019.; Web Technologies track at the 32rd ACM/SIGAPP Symposium On Applied Computing, SAC 2017, Web Technologies track at the 33nd ACM/SIGAPP Symposium On Applied Computing, SAC 2018 and oftware Development for Mobile Devices, Wearables, and the Internet-of-Things Minitrack at the 51st Hawaii International Conference on System Sciences, HICSS 2018 ; Conference date: 09-04-2018 Through 13-04-2018",

year = "2019",

doi = "10.1007/978-3-030-28430-5\_1",

language = "English",

isbn = "9783030284299",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer Verlag",

pages = "1--20",

editor = "Majchrzak, \{Tim A.\} and Cristian Mateos and Francesco Poggi and Tor-Morten Gr{\o}nli",

booktitle = "Towards Integrated Web, Mobile, and IoT Technology - Selected and Revised Papers from the Web Technologies Track at SAC 2017 and SAC 2018, and the Software Development for Mobile Devices, Wearables, and the IoT Minitrack at HICSS 2018",

address = "Germany",

}

Brown, J, Zhou, ZQ & Chow, YW 2019, Metamorphic Testing of Mapping Software. in TA Majchrzak, C Mateos, F Poggi & T-M Grønli (eds), Towards Integrated Web, Mobile, and IoT Technology - Selected and Revised Papers from the Web Technologies Track at SAC 2017 and SAC 2018, and the Software Development for Mobile Devices, Wearables, and the IoT Minitrack at HICSS 2018. Lecture Notes in Business Information Processing, vol. 347, Springer Verlag, pp. 1-20, Web Technologies track at the 32rd ACM/SIGAPP Symposium On Applied Computing, SAC 2017, Web Technologies track at the 33nd ACM/SIGAPP Symposium On Applied Computing, SAC 2018 and oftware Development for Mobile Devices, Wearables, and the Internet-of-Things Minitrack at the 51st Hawaii International Conference on System Sciences, HICSS 2018, Pau, France, 9/04/18. https://doi.org/10.1007/978-3-030-28430-5_1

Metamorphic Testing of Mapping Software. / Brown, Joshua; Zhou, Zhi Quan; Chow, Yang Wai.
Towards Integrated Web, Mobile, and IoT Technology - Selected and Revised Papers from the Web Technologies Track at SAC 2017 and SAC 2018, and the Software Development for Mobile Devices, Wearables, and the IoT Minitrack at HICSS 2018. ed. / Tim A. Majchrzak; Cristian Mateos; Francesco Poggi; Tor-Morten Grønli. Springer Verlag, 2019. p. 1-20 (Lecture Notes in Business Information Processing; Vol. 347).

Research output: Chapter in Book/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Metamorphic Testing of Mapping Software

AU - Brown, Joshua

AU - Zhou, Zhi Quan

AU - Chow, Yang Wai

N1 - Publisher Copyright: © Springer Nature Switzerland AG 2019.

PY - 2019

Y1 - 2019

N2 - Mapping software is difficult to test because it is very costly to evaluate its output. This difficulty is generally known as the oracle problem, a fundamental challenge in software testing. In this paper, we propose a metamorphic testing strategy to alleviate the oracle problem in testing mapping software. We first conduct a case study to test Google Maps, the most popular web mapping service. The results of the case study show that our testing approach is effective, with the detection of several real-life bugs that can hardly be exposed under conventional testing paradigms. Following this, we conduct an analysis of the system OpenStreetMap, well-known open-source mapping software built and maintained by a community of users. We show the potential of metamorphic testing for such systems. These case studies show that metamorphic testing can be applied to mapping software for both verification and validation purposes.

AB - Mapping software is difficult to test because it is very costly to evaluate its output. This difficulty is generally known as the oracle problem, a fundamental challenge in software testing. In this paper, we propose a metamorphic testing strategy to alleviate the oracle problem in testing mapping software. We first conduct a case study to test Google Maps, the most popular web mapping service. The results of the case study show that our testing approach is effective, with the detection of several real-life bugs that can hardly be exposed under conventional testing paradigms. Following this, we conduct an analysis of the system OpenStreetMap, well-known open-source mapping software built and maintained by a community of users. We show the potential of metamorphic testing for such systems. These case studies show that metamorphic testing can be applied to mapping software for both verification and validation purposes.

KW - Google Maps

KW - Graphical User Interface

KW - Mapping software

KW - Metamorphic testing

KW - Navigation software

KW - OpenStreetMap

KW - Oracle problem

KW - Software testing

KW - Web service

UR - https://www.scopus.com/pages/publications/85071944282

U2 - 10.1007/978-3-030-28430-5_1

DO - 10.1007/978-3-030-28430-5_1

M3 - Conference contribution

AN - SCOPUS:85071944282

SN - 9783030284299

T3 - Lecture Notes in Business Information Processing

SP - 1

EP - 20

BT - Towards Integrated Web, Mobile, and IoT Technology - Selected and Revised Papers from the Web Technologies Track at SAC 2017 and SAC 2018, and the Software Development for Mobile Devices, Wearables, and the IoT Minitrack at HICSS 2018

A2 - Majchrzak, Tim A.

A2 - Mateos, Cristian

A2 - Poggi, Francesco

A2 - Grønli, Tor-Morten

PB - Springer Verlag

T2 - Web Technologies track at the 32rd ACM/SIGAPP Symposium On Applied Computing, SAC 2017, Web Technologies track at the 33nd ACM/SIGAPP Symposium On Applied Computing, SAC 2018 and oftware Development for Mobile Devices, Wearables, and the Internet-of-Things Minitrack at the 51st Hawaii International Conference on System Sciences, HICSS 2018

Y2 - 9 April 2018 through 13 April 2018

ER -

Brown J, Zhou ZQ, Chow YW. Metamorphic Testing of Mapping Software. In Majchrzak TA, Mateos C, Poggi F, Grønli TM, editors, Towards Integrated Web, Mobile, and IoT Technology - Selected and Revised Papers from the Web Technologies Track at SAC 2017 and SAC 2018, and the Software Development for Mobile Devices, Wearables, and the IoT Minitrack at HICSS 2018. Springer Verlag. 2019. p. 1-20. (Lecture Notes in Business Information Processing). doi: 10.1007/978-3-030-28430-5_1

Metamorphic Testing of Mapping Software

Abstract

Publication series

Conference

Free Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this