SAM2 for abdomen: One-shot and no finetuning

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The study introduces SAM2, a novel method for fully automatic abdominal organ segmentation using the Segment Anything Model 2 (SAM2) and Self-Supervised Anatomical Embedding (Emb-SAM). Unlike traditional approaches, our model achieves superior segmentation performance without the need for finetuning or large labeled datasets, relying on a single labeled image. SAM2 leverages its memory bank for mask propagation, originally designed for video segmentation, which we adapt for 3D medical imaging by treating CT slices as sequential frames. Emb-SAM generates precise pseudo-labels by matching anatomical points across images using self-supervised learning. The proposed method effectively segments abdominal organs such as the liver, kidneys, spleen, and aorta, demonstrating superior consistency compared to baseline models on the BTCV dataset. Experimental results show that our model achieves competitive performance, significantly reducing computational costs and manual intervention, thus offering a promising solution for automated medical image segmentation.

Original languageEnglish
Title of host publicationICIIBMS 2024 - 9th International Conference on Intelligent Informatics and BioMedical Sciences
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages551-555
Number of pages5
Edition2024
ISBN (Electronic)9798350363043
DOIs
StatePublished - 2024
Event9th International Conference on Intelligent Informatics and BioMedical Sciences, ICIIBMS 2024 - Vitual, Okinawa, Japan
Duration: 21 Nov 202423 Nov 2024

Conference

Conference9th International Conference on Intelligent Informatics and BioMedical Sciences, ICIIBMS 2024
Country/TerritoryJapan
CityVitual, Okinawa
Period21/11/2423/11/24

Keywords

  • Abdomen segmentation
  • no finetuning
  • one-shot segmentation
  • segment anything model 2

Fingerprint

Dive into the research topics of 'SAM2 for abdomen: One-shot and no finetuning'. Together they form a unique fingerprint.

Cite this