Privileged Modality Guided Network for Retinal Vessel Segmentation in Ultra-Wide-Field Images

Xuefei Li, Huaying Hao, Huazhu Fu, Dan Zhang, Da Chen, Yuchuan Qiao, Jiang Liu, Yitian Zhao, Jiong Zhang

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review


Retinal vessel segmentation in ophthalmic images is an essential task to support the computer-aided diagnosis of eye-related diseases. As a non-invasive imaging technique, ultra-wide-field (UWF) fundus imaging provides a large field-of-view (FOV) of 200 with full coverage of the retinal territory, making it a suitable modality for vessel analysis. However, imaging the large FOV may result in low-contrast vascular details and background artifacts, which pose challenges to the accurate segmentation of retinal microvasculature. To address these issues, a privileged modality guided multi-scale location-aware fusion network is proposed for vessel segmentation in UWF images. We first perform style transfer on the UWF images to generate the corresponding FFA image with higher contrast. Afterwards, we employ cross-modal coherence loss to segment the vessels guided by the FFA image. Additionally, a multi-scale location-aware fusion module is proposed and embedded into the segmentation network for reducing the boundary artifacts. Finally, experiments are performed on a dedicated UWF dataset, and the evaluation results demonstrate that our method achieves competitive vessel segmentation performance with a Dice score of around 78.13 %. This indicates that our method is potentially valuable for subsequent vessel analysis to support disease diangosis.

Original languageEnglish
Title of host publicationOphthalmic Medical Image Analysis - 10th International Workshop, OMIA 2023, Held in Conjunction with MICCAI 2023, Proceedings
EditorsBhavna Antony, Hao Chen, Huihui Fang, Huazhu Fu, Cecilia S. Lee, Yalin Zheng
PublisherSpringer Science and Business Media Deutschland GmbH
Number of pages10
ISBN (Print)9783031440120
Publication statusPublished - 2023
Externally publishedYes
Event10th International Workshop on Ophthalmic Medical Image Analysis, OMIA-X 2023 - Vancouver, Canada
Duration: 12 Oct 202312 Oct 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14096 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference10th International Workshop on Ophthalmic Medical Image Analysis, OMIA-X 2023


  • Location-aware
  • Privileged modality
  • UWF
  • Vessel segmentation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science (all)


Dive into the research topics of 'Privileged Modality Guided Network for Retinal Vessel Segmentation in Ultra-Wide-Field Images'. Together they form a unique fingerprint.

Cite this