Multi-scale U-net with Edge Guidance for Multimodal Retinal Image Deformable Registration

Yuntong Tian, Yan Hu, Yuhui Ma, Huaying Hao, Lei Mou, Jianlong Yang, Yitian Zhao, Jiang Liu

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

10 Citations (Scopus)

Abstract

Registration of multimodal retinal images is of great importance in facilitating the diagnosis and treatment of many eye diseases, such as the registration between color fundus images and optical coherence tomography (OCT) images. However, it is difficult to obtain ground truth, and most existing algorithms are for rigid registration without considering the optical distortion. In this paper, we present an unsupervised learning method for deformable registration between the two images. To solve the registration problem, the structure achieves a multi-level receptive field and takes contour and local detail into account. To measure the edge difference caused by different distortions in the optics center and edge, an edge similarity (ES) loss term is proposed, so loss function is composed by local cross-correlation, edge similarity and diffusion regularizer on the spatial gradients of the deformation matrix. Thus, we propose a multi-scale input layer, U-net with dilated convolution structure, squeeze excitation (SE) block and spatial transformer layers. Quantitative experiments prove the proposed framework is best compared with several conventional and deep learningbased methods, and our ES loss and structure combined with Unet and multi-scale layers achieve competitive results for normal and abnormal images.

Original languageEnglish
Title of host publication42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
Subtitle of host publicationEnabling Innovative Technologies for Global Healthcare, EMBC 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1360-1363
Number of pages4
ISBN (Electronic)9781728119908
DOIs
Publication statusPublished - Jul 2020
Externally publishedYes
Event42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 - Montreal, Canada
Duration: 20 Jul 202024 Jul 2020

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2020-July
ISSN (Print)1557-170X

Conference

Conference42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020
Country/TerritoryCanada
CityMontreal
Period20/07/2024/07/20

Keywords

  • Color Fundus
  • Deep Learning
  • Deformable Registration
  • Multimodal Registration
  • Optical Coherence Tomography

ASJC Scopus subject areas

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Fingerprint

Dive into the research topics of 'Multi-scale U-net with Edge Guidance for Multimodal Retinal Image Deformable Registration'. Together they form a unique fingerprint.

Cite this