TY - GEN
T1 - MambaVesselNet
T2 - 6th ACM International Conference on Multimedia in Asia, MMAsia 2024
AU - Chen, Yanming
AU - Liu, Ziyu
AU - He, Xiangjian
N1 - Publisher Copyright:
© 2024 Copyright held by the owner/author(s).
PY - 2024/12/28
Y1 - 2024/12/28
N2 - Segmenting vessels in magnetic resonance imaging (MRI) stands as a mainstream approach for evaluating cerebrovascular conditions. Due to the complex semantics and topology of cerebrovascular structures, existing CNN-based segmentation methods often fail to correlate the topological structure and branch vessels, resulting in incomplete segmentation. To address the challenge of global dependencies modelling, transformer architectures have been employed due to their capability of capturing long-range dependencies, and they have shown promise in 3D medical image segmentation. However, the transformer architecture greatly increases the computational burden when processing high-dimensional 3D MRI images. In light of this, a selective state space model (SSM) Mamba has gained recognition for its adeptness in handling long-range dependencies in sequential data, particularly noted for its efficiency and speed in natural language processing applications. Mamba is now widely applied in various computer vision tasks. Based on these findings, in this study, we propose MambaVesselNet, a Hybrid CNN-Mamba network for 3D cerebrovascular segmentation. MambaVesselNet leverages CNNs to capture local features and incorporates the Mamba block at the bottleneck to model long-range dependencies within the whole-volume features. The effectiveness of MambaVesselNet is validated on a public cerebrovascular dataset, and our benchmark demonstrates new state-of-the-art performance.
AB - Segmenting vessels in magnetic resonance imaging (MRI) stands as a mainstream approach for evaluating cerebrovascular conditions. Due to the complex semantics and topology of cerebrovascular structures, existing CNN-based segmentation methods often fail to correlate the topological structure and branch vessels, resulting in incomplete segmentation. To address the challenge of global dependencies modelling, transformer architectures have been employed due to their capability of capturing long-range dependencies, and they have shown promise in 3D medical image segmentation. However, the transformer architecture greatly increases the computational burden when processing high-dimensional 3D MRI images. In light of this, a selective state space model (SSM) Mamba has gained recognition for its adeptness in handling long-range dependencies in sequential data, particularly noted for its efficiency and speed in natural language processing applications. Mamba is now widely applied in various computer vision tasks. Based on these findings, in this study, we propose MambaVesselNet, a Hybrid CNN-Mamba network for 3D cerebrovascular segmentation. MambaVesselNet leverages CNNs to capture local features and incorporates the Mamba block at the bottleneck to model long-range dependencies within the whole-volume features. The effectiveness of MambaVesselNet is validated on a public cerebrovascular dataset, and our benchmark demonstrates new state-of-the-art performance.
KW - 3D medical imaging
KW - Cerebrovascular segmentation
KW - Mamba
KW - State space models
UR - http://www.scopus.com/inward/record.url?scp=85216252872&partnerID=8YFLogxK
U2 - 10.1145/3696409.3700231
DO - 10.1145/3696409.3700231
M3 - Conference contribution
AN - SCOPUS:85216252872
T3 - Proceedings of the 6th ACM International Conference on Multimedia in Asia, MMAsia 2024
BT - Proceedings of the 6th ACM International Conference on Multimedia in Asia, MMAsia 2024
PB - Association for Computing Machinery, Inc
Y2 - 3 December 2024 through 6 December 2024
ER -