First attempt to build realistic driving scenes using video-to-video synthesis in OpenDS framework

Zili Song, Shuolei Wang, Xiangjun Peng, Weikai Kong, Xu Sun

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

7 Citations (Scopus)
4 Downloads (Pure)

Abstract

Existing programmable simulators enable researchers to customize different driving scenarios to conduct in-lab automotive driver simulations. However, software-based simulators for cognitive research generate and maintain their scenes with the support of 3D engines, which may affect users’ experiences to a certain degree since they are not sufficiently realistic. Now, a critical issue is the question of how to build scenes into real-world ones. In this paper, we introduce the first step in utilizing video-to-video synthesis, which is a deep learning approach, in OpenDS framework, which is an open-source driving simulator software, to present simulated scenes as realistically as possible. Off-line evaluations demonstrated promising results from our study, and our future work will focus on how to merge them appropriately to build a close-to-reality, real-time driving simulator.

Original languageEnglish
Title of host publicationAdjunct Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019
PublisherAssociation for Computing Machinery, Inc
Pages387-391
Number of pages5
ISBN (Electronic)9781450369206
DOIs
Publication statusPublished - 21 Sep 2019
Event11th ACM International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019 - Utrecht, Netherlands
Duration: 21 Sep 201925 Sep 2019

Publication series

NameAdjunct Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019

Conference

Conference11th ACM International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019
Country/TerritoryNetherlands
CityUtrecht
Period21/09/1925/09/19

Keywords

  • Driving simulator
  • Machine learning
  • Video synthesis

ASJC Scopus subject areas

  • Automotive Engineering
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'First attempt to build realistic driving scenes using video-to-video synthesis in OpenDS framework'. Together they form a unique fingerprint.

Cite this