TY - GEN
T1 - Enhancing Cerebral Microbleed Segmentation with Pretrained UNETR++
AU - Kwon, Junmo
AU - Seo, Sang Won
AU - Park, Hyunjin
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Accurate segmentation of cerebral microbleeds (CMBs) is important for diagnosing small vessel diseases, yet it presents significant challenges due to their tiny size and especially the high risk of false positives (e.g., calcifications and blood flow in pial vessels) in magnetic resonance imaging (MRI). While existing studies have employed multi-stage deep neural networks to reduce false positives, these approaches often rely heavily on the performance of the false positive reduction module. To address this and move towards an end-to-end learning scheme, we propose a novel approach that incorporates self-supervised learning through masked image modeling to enrich both encoder and decoder features in UNETR++ using gradient recalled echo T2*-weighted MRI. Noting that existing pre-training strategies often focus on the encoder while neglecting the decoder, our approach pre-trains both components by introducing segmentation and reconstruction heads. We evaluated our model on an in-house dataset and external validation set, demonstrating superior performance compared to the state-of-the-art nnUNet and nnDetection. Additionally, ablation studies revealed that pre-training both the encoder and decoder subsequently benefits the overall performance of our framework. Our code is available at https://github.com/junmokwon/UNETRppCMBSeg.
AB - Accurate segmentation of cerebral microbleeds (CMBs) is important for diagnosing small vessel diseases, yet it presents significant challenges due to their tiny size and especially the high risk of false positives (e.g., calcifications and blood flow in pial vessels) in magnetic resonance imaging (MRI). While existing studies have employed multi-stage deep neural networks to reduce false positives, these approaches often rely heavily on the performance of the false positive reduction module. To address this and move towards an end-to-end learning scheme, we propose a novel approach that incorporates self-supervised learning through masked image modeling to enrich both encoder and decoder features in UNETR++ using gradient recalled echo T2*-weighted MRI. Noting that existing pre-training strategies often focus on the encoder while neglecting the decoder, our approach pre-trains both components by introducing segmentation and reconstruction heads. We evaluated our model on an in-house dataset and external validation set, demonstrating superior performance compared to the state-of-the-art nnUNet and nnDetection. Additionally, ablation studies revealed that pre-training both the encoder and decoder subsequently benefits the overall performance of our framework. Our code is available at https://github.com/junmokwon/UNETRppCMBSeg.
KW - Cerebral Microbleeds
KW - Gradient Recalled Echo Imaging
KW - Masked Image Modeling
KW - Semantic Segmentation
KW - Transformers
UR - https://www.scopus.com/pages/publications/85217276589
U2 - 10.1109/BIBM62325.2024.10822393
DO - 10.1109/BIBM62325.2024.10822393
M3 - Conference contribution
AN - SCOPUS:85217276589
T3 - Proceedings - 2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024
SP - 3372
EP - 3377
BT - Proceedings - 2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024
A2 - Cannataro, Mario
A2 - Zheng, Huiru
A2 - Gao, Lin
A2 - Cheng, Jianlin
A2 - de Miranda, Joao Luis
A2 - Zumpano, Ester
A2 - Hu, Xiaohua
A2 - Cho, Young-Rae
A2 - Park, Taesung
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024
Y2 - 3 December 2024 through 6 December 2024
ER -