Enhancing Euro NCAP Standards with Metamorphic Testing for Verification of Advanced Driver-Assistance Systems

Muhammad Iqbal, Jia Cheng Han, Zhi Quan Zhou, Dave Towey

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

6 Citations (Scopus)

Abstract

Advanced Driver-Assistance Systems (ADASs) have become increasingly popular. To ensure safety, simulation testing is essential. In this research, we conducted a case study to investigate the fault-detection effectiveness of existing ADAS testing standards: We tested the Lane Keeping Assist System (LKAS), which is a prebuilt ADAS module of MATLAB and Simulink. We first tested LKAS using the European New Car Assessment Programme (Euro NCAP), which contains 40 prebuilt driving scenarios in MATLAB. Our results show that none of the 40 scenarios detected any failure. We then continued the tests by applying a simple metamorphic relation equivalence under geometric transformation, and a previously unknown real-life bug in LKAS was immediately revealed. We reported this finding to the MATLAB team in the US, who then confirmed the bug and corrected the LKAS code. This research provides a strong case for incorporating metamorphic testing into ADAS testing standards and protocols.

Original languageEnglish
Title of host publicationProceedings - 2021 IEEE/ACM 6th International Workshop on Metamorphic Testing, MET 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages37-41
Number of pages5
ISBN (Electronic)9781665444644
DOIs
Publication statusPublished - Jun 2021
Externally publishedYes
Event6th IEEE/ACM International Workshop on Metamorphic Testing, MET 2021 - Virtual, Online, Spain
Duration: 2 Jun 2021 → …

Publication series

NameProceedings - 2021 IEEE/ACM 6th International Workshop on Metamorphic Testing, MET 2021

Conference

Conference6th IEEE/ACM International Workshop on Metamorphic Testing, MET 2021
Country/TerritorySpain
CityVirtual, Online
Period2/06/21 → …

Keywords

  • ADAS
  • Software testing standard
  • lane keeping assist system
  • metamorphic testing
  • oracle problem
  • symmetry metamorphic relation pattern

ASJC Scopus subject areas

  • Information Systems
  • Safety, Risk, Reliability and Quality
  • Library and Information Sciences
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Enhancing Euro NCAP Standards with Metamorphic Testing for Verification of Advanced Driver-Assistance Systems'. Together they form a unique fingerprint.

Cite this