SC-GAN: Structure Consistent GAN for Modality Transfer with FFT and Multi-Scale Perception

Ruiling Xi, Yinglin Zhang, Ruibin Bai, Risa Higashita, Jiang Liu

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

Abstract

The quality of the cornea endothelial microscopy image is critical for clinical analysis. Although the noncontact specular microscope is more user-friendly than the contact confocal microscope, the imaging quality of the specular microscope is lower. The modality transfer is a promising solution for image quality enhancement. This paper proposes a Structure Consistent Generative Adversarial Network (SC-GAN) to transfer the imaging style from the specular microscope to the confocal microscope. Specifically, we use the Fourier frequency domain consistency to preserve cell structure and propose a multi-scale perception discriminator to improve model robustness under cell size variation. Experiment results prove the effectiveness of our method.

Original languageEnglish
Title of host publication2023 IEEE International Symposium on Biomedical Imaging, ISBI 2023
PublisherIEEE Computer Society
ISBN (Electronic)9781665473583
DOIs
Publication statusPublished - 2023
Event20th IEEE International Symposium on Biomedical Imaging, ISBI 2023 - Cartagena, Colombia
Duration: 18 Apr 202321 Apr 2023

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2023-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference20th IEEE International Symposium on Biomedical Imaging, ISBI 2023
Country/TerritoryColombia
CityCartagena
Period18/04/2321/04/23

Keywords

  • Corneal Endothelial Cell
  • Generative Adversarial Network
  • Modality transfer
  • Structure Consistency

ASJC Scopus subject areas

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'SC-GAN: Structure Consistent GAN for Modality Transfer with FFT and Multi-Scale Perception'. Together they form a unique fingerprint.

Cite this