Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets

Eugene Ch’ng, Pinyuan Feng, Hongtao Yao, Zihao Zeng, Danzhao Cheng, Shengdan Cai

Research output: Chapter in Book/Conference proceedingBook Chapter

4 Downloads (Pure)

Abstract

Cultural heritage presents both challenges and opportunities for the adoption and use of deep learning in 3D digitisation and digitalisation endeavours. While unique features in terms of the identity of artefacts are important factors that can contribute to training performance in deep learning algorithms, challenges remain with regards to the laborious efforts in our ability to obtain adequate datasets that would both provide for the diversity of imageries, and across the range of multi-facet images for each object in use. One solution, and perhaps an important step towards the broader applicability of deep learning in the field of digital heritage is the fusion of both real and virtual datasets via the automated creation of diverse datasets that covers multiple views of individual objects over a range of diversified objects in the training pipeline, all facilitated by closerange photogrammetry generated 3D objects. The question is the ratio of the combination of real and synthetic imageries in which an inflection point occurs whereby performance is reduced. In this research, we attempt to reduce the need for manual labour by leveraging the flexibility provided for in automated data generation via close-range photogrammetry models with a view for future deep learning facilitated cultural heritage activities, such as digital identification, sorting, asset management and categorisation.
Original languageEnglish
Title of host publicationProceedings of the 13th International Conference on Agents and Artificial Intelligence
Place of PublicationPortugal
PublisherSciTePress
Pages611-621
Volume1
ISBN (Print)9789897584848
DOIs
Publication statusPublished - 4 Feb 2021
Event13th International Conference on Agents and Artificial Intelligence, ICAART 2021 -
Duration: 4 Feb 20216 Feb 2021

Publication series

Name
PublisherSCITEPRESS

Conference

Conference13th International Conference on Agents and Artificial Intelligence, ICAART 2021
Period4/02/216/02/21

Keywords

  • digital heritage;deep learning;object detection; data augmentation; photogrammetry; fusion dataset

Fingerprint

Dive into the research topics of 'Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets'. Together they form a unique fingerprint.

Cite this