Cycle Structure and Illumination Constrained GAN for Medical Image Enhancement

Yuhui Ma, Yonghuai Liu, Jun Cheng, Yalin Zheng, Morteza Ghahremani, Honghan Chen, Jiang Liu, Yitian Zhao

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

16 Citations (Scopus)

Abstract

The non-uniform illumination or imbalanced intensity in medical images brings challenges for automated screening, examination and diagnosis of diseases. Previously, CycleGAN was proposed to transform input images into enhanced ones without paired images. However, it did not consider many local details of the structures, which are essential for medical images. In this paper, we propose a Cycle Structure and Illumination constrained GAN (CSI-GAN), for medical image enhancement. Inspired by CycleGAN based on the global constraints of the adversarial loss and cycle consistency, the proposed CSI-GAN treats low and high quality images as those in two domains and computes local structure and illumination constraints for learning both overall characteristics and local details. To evaluate the effectiveness of CSI-GAN, we have conducted experiments over two medical image datasets: corneal confocal microscopy (CCM) and endoscopic images. The experimental results show that our method yields better performance than both conventional methods and other deep learning based methods. As a complementary output, we will release the CCM dataset to the public in the future.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention – MICCAI 2020 - 23rd International Conference, Proceedings
EditorsAnne L. Martel, Purang Abolmaesumi, Danail Stoyanov, Diana Mateus, Maria A. Zuluaga, S. Kevin Zhou, Daniel Racoceanu, Leo Joskowicz
PublisherSpringer Science and Business Media Deutschland GmbH
Pages667-677
Number of pages11
ISBN (Print)9783030597122
DOIs
Publication statusPublished - 2020
Externally publishedYes
Event23rd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2020 - Lima, Peru
Duration: 4 Oct 20208 Oct 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12262 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference23rd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2020
Country/TerritoryPeru
CityLima
Period4/10/208/10/20

Keywords

  • CycleGAN
  • Illumination regularization
  • Medical image enhancement
  • Structural loss

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Cycle Structure and Illumination Constrained GAN for Medical Image Enhancement'. Together they form a unique fingerprint.

Cite this