Reassembling Consistent-Complementary Constraints in Triplet Network for Multi-view Learning of Medical Images

Xingyue Wang, Jiansheng Fang, Na Zeng, Jingqi Huang, Hanpei Miao, William Robert Kwapong, Ziyi Zhang, Shuting Zhang, Jiang Liu

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Existing multi-view learning methods based on the information bottleneck principle exhibit impressing generalization by capturing inter-view consistency and complementarity. They leverage cross-view joint information (consistency) and view-specific information (complementarity) while discarding redundant information. By fusing visual features, multi-view learning methods help medical image processing to produce more reliable predictions. However, multi-views of medical images often have low consistency and high complementarity due to modal differences in imaging or different projection depths, thus challenging existing methods to balance them to the maximal extent. To mitigate such an issue, we improve the information bottleneck (IB) loss function with a balanced regularization term, termed IBB loss, reassembling the constraints of multi-view consistency and complementarity. In particular, the balanced regularization term with a unique trade-off factor in IBB loss helps minimize the mutual information on consistency and complementarity to strike a balance. In addition, we devise a triplet multi-view network named TM net to learn the consistent and complementary features from multi-view medical images. By evaluating two datasets, we demonstrate the superiority of our method against several counterparts. The extensive experiments also confirm that our IBB loss significantly improves multi-view learning in medical images.

Original languageEnglish
Title of host publicationProceedings - 2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022
EditorsDonald Adjeroh, Qi Long, Xinghua Shi, Fei Guo, Xiaohua Hu, Srinivas Aluru, Giri Narasimhan, Jianxin Wang, Mingon Kang, Ananda M. Mondal, Jin Liu
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1235-1240
Number of pages6
ISBN (Electronic)9781665468190
DOIs
Publication statusPublished - 2022
Externally publishedYes
Event2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022 - Las Vegas, United States
Duration: 6 Dec 20228 Dec 2022

Publication series

NameProceedings - 2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022

Conference

Conference2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022
Country/TerritoryUnited States
CityLas Vegas
Period6/12/228/12/22

Keywords

  • deep learning
  • information bottleneck
  • medical images
  • multi-view

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Information Systems and Management
  • Biomedical Engineering
  • Medicine (miscellaneous)
  • Cardiology and Cardiovascular Medicine
  • Health Informatics

Fingerprint

Dive into the research topics of 'Reassembling Consistent-Complementary Constraints in Triplet Network for Multi-view Learning of Medical Images'. Together they form a unique fingerprint.

Cite this