2611005549
  • Open Access
  • Article

From Fully-Automatic to Efficient Interaction: A Lightweight Prompting Framework for Jaw Cyst Segmentation

  • Chao Li 1,   
  • Zhe Rao 2,3,   
  • Tinglong Tang 2,3,   
  • Zhenyang Wang 4,   
  • Yalin Wang 5 and 
  • Xiaotian Pan 6,*

Received: 21 September 2026 | Revised: 28 October 2026 | Accepted: 02 November 2026 | Published: 17 November 2026

Abstract

Faint, interrupted boundaries make jaw cysts difficult to delineate in medical images. Clinicians can help identify the lesion, yet a fully automatic segmentation model has no direct means of using their assessment to guide an individual mask. We developed PromptFormer to accept bounding box prompts through a compact medical segmentation backbone. Its Plug-in Prompt Process Module (PPPM) couples that backbone to the prompt encoder and mask decoder of the Segment Anything Model (SAM); SAM’s image encoder is omitted. The backbone is supplemented by a Frequency-domain Global Perception Module (FGPM) for global structure and a Multi-scale Detail Refinement Module (MDRM) for spatial detail. Tests used a clinically collected jaw cyst dataset, BUSI, and ISIC 2017. Across the three datasets, the highest Intersection over Union (IoU) among the compared models was obtained by PromptFormer. Its jaw cyst Dice score was 93.79%. Relative to the SAM-based comparators in the efficiency test, fewer than one seventh as many floating-point operations were needed, and inference was approximately 2.7 to 8.6 times as fast. These computational savings, together with the prompt interface, justify further evaluation on clinical devices with limited resources.

References 

  • 1.

    Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Proceedings of the 18th International Conference, Munich, Germany, 5–9 October 2015; Springer: Cham, Switzerland, 2015; pp. 234–241. https://doi.org/10.1007/978-3-319-24574-4_28.

  • 2.

    He, A.; Wang, K.; Li, T.; et al. H2Former: An Efficient Hierarchical Hybrid Transformer for Medical Image Segmentation. IEEE Trans. Med. Imaging 2023, 42, 2763–2775. https://doi.org/10.1109/tmi.2023.3264513.

  • 3.

    Chen, J.; Lu, Y.; Yu, Q.; et al. TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation. arXiv 2021, arXiv:2102.04306.

  • 4.

    Sofiiuk, K.; Petrov, I.A.; Konushin, A. Reviving Iterative Training with Mask Guidance for Interactive Segmentation. In Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France, 16–19 October 2022; pp. 3141–3145. https://doi.org/10.1109/icip46576.2022.9897365.

  • 5.

    Marinov, Z.; Jäger, P.F.; Egger, J.; et al. Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomy. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 10998–11018. https://doi.org/10.1109/tpami.2024.3452629.

  • 6.

    Kirillov, A.; Mintun, E.; Ravi, N.; et al. Segment Anything. In Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France, 1–6 October 2023; pp. 3992–4003. https://doi.org/10.1109/iccv51070.2023.00371.

  • 7.

    Houlsby, N.; Giurgiu, A.; Jastrzebski, S.; et al. Parameter-Efficient Transfer Learning for NLP. In Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA, 9–15 June 2019; pp. 2790–2799.

  • 8.

    Hu, E.J.; Shen, Y.; Wallis, P.; et al. LoRA: Low-Rank Adaptation of Large Language Models. arXiv 2021, arXiv:2106.09685.

  • 9.

    Li, C.; Liu, X.; Li, W.; et al. U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation. In Proceedings of the AAAI Conference on Artificial Intelligence, Philadelphia, PA, USA, 25 February–4 March 2025; Volume 39, pp. 4652–4660.

  • 10.

    Li, P.; Qiu, Z.; Zhan, Y.; et al. Multi-Scale Bottleneck Residual Network for Retinal Vessel Segmentation. J. Med. Syst. 2023, 47, 102. https://doi.org/10.1007/s10916-023-01992-7.

  • 11.

    Hu, J.; Yang, Z.; Wang, P.; et al. Federated Learning for Medical Image Analysis: Privacy-Preserving Paradigms and Clinical Challenges. Trans. Artif. Intell. 2025, 1, 153–169. https://doi.org/10.53941/tai.2025.100010.

  • 12.

    Piao, H.; Wu, D.O. Federated Continual Learning for Privacy-Preserving, Reliable and Interpretable Multi-Center Corneal Diseases Diagnosis. Trans. Artif. Intell. 2026, 2, 119–130. https://doi.org/10.53941/tai.2026.100008.

  • 13.

    Takahashi, S.; Sakaguchi, Y.; Kouno, N.; et al. Comparison of Vision Transformers and Convolutional Neural Networks in Medical Image Analysis: A Systematic Review. J. Med. Syst. 2024, 48, 84. https://doi.org/10.1007/s10916-024-02105-8.

  • 14.

    Cao, H.; Wang, Y.; Chen, J.; et al. Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation. In Lecture Notes in Computer Science, Proceedings of the Computer Vision–ECCV 2022 Workshops, Tel Aviv, Israel, 23–27 October 2022; Springer: Cham, Switzerland, 2023; pp. 205–218. https://doi.org/10.1007/978-3-031-25066-8_9.

  • 15.

    Zhou, Z.; He, A.; Wu, Y.; et al. Spatial-Frequency Dual Domain Attention Network for Medical Image Segmentation. In Proceedings of the 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Lisbon, Portugal, 3–6 December 2024; pp. 4076–4081. https://doi.org/10.1109/bibm62325.2024.10822613.

  • 16.

    Zhang, M.; Feng, J.; Yang, H.; et al. IRPruneDeXt: Efficient Infrared Small Target Detection via Musical Wavelet-Regularized Channel Pruning. IEEE Trans. Neural Netw. Learn. Syst. 2025, 36, 20229–20242. https://doi.org/10.1109/tnnls.2025.3594958.

  • 17.

    Chen, L.; Li, J.; Ge, H. TBUnet: A Pure Convolutional U-Net Capable of Multifaceted Feature Extraction for Medical Image Segmentation. J. Med. Syst. 2023, 47, 122. https://doi.org/10.1007/s10916-023-02014-2.

  • 18.

    Zhu, Z.; Zhu, H.; Lu, S.Y.; et al. Dual-Kernel Adapter: Expanding Spatial Horizons for Data-Constrained Medical Image Analysis. In Proceedings of the International Conference on Learning Representations, Rio de Janeiro, Brazil, 23–27 April 2026; Volume 2026, pp. 116057–116088.

  • 19.

    Rother, C.; Kolmogorov, V.; Blake, A. GrabCut: Interactive Foreground Extraction Using Iterated Graph Cuts. ACM Trans. Graph. 2004, 23, 309–314. https://doi.org/10.1145/1015706.1015720.

  • 20.

    Liu, Q.; Xu, Z.; Bertasius, G.; et al. SimpleClick: Interactive Image Segmentation with Simple Vision Transformers. In Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France, 1–6 October 2023; pp. 22233–22243. https://doi.org/10.1109/iccv51070.2023.02037.

  • 21.

    Ma, J.; He, Y.; Li, F.; et al. Segment Anything in Medical Images. Nat. Commun. 2024, 15, 654. https://doi.org/10.1038/s41467-024-44824-z.

  • 22.

    Wu, J.; Wang, Z.; Hong, M.; et al. Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation. Med. Image Anal. 2025, 102, 103547. https://doi.org/10.1016/j.media.2025.103547.

  • 23.

    Zhang, K.; Liu, D. Customized Segment Anything Model for Medical Image Segmentation. arXiv 2023, arXiv:2304.13785.

  • 24.

    Peng, Z.; Xu, Z.; Zeng, Z.; et al. SAM-PARSER: Fine-Tuning SAM Efficiently by Parameter Space Reconstruction. In Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada, 20–27 February 2024; Volume 38, pp. 4515–4523.

  • 25.

    Cai, Y.; Fan, D.J.; Gao, F.; et al. BoxPolypSAM: Leveraging SAM in Box-Supervised Polyp Segmentation. In Proceedings of the 2025 IEEE 22nd International Symposium on Biomedical Imaging (ISBI), Houston, TX, USA, 14–17 April 2025; pp. 1–5. https://doi.org/10.1109/isbi60581.2025.10980797.

  • 26.

    Mazurowski, M.A.; Dong, H.; Gu, H.; et al. Segment Anything Model for Medical Image Analysis: An Experimental Study. Med. Image Anal. 2023, 89, 102918. https://doi.org/10.1016/j.media.2023.102918.

  • 27.

    Lin, X.; Xiang, Y.; Yu, L.; et al. Beyond Adapting SAM: Towards End-to-End Ultrasound Image Segmentation via Auto Prompting. In Lecture Notes in Computer Science, Proceedings of the Medical Image Computing and Computer Assisted Intervention—MICCAI 2024, Marrakesh, Morocco, 6–10 October 2024; Springer: Cham, Switzerland, 2024; pp. 24–34. https://doi.org/10.1007/978-3-031-72111-3_3.

  • 28.

    Zheng, H.; Jiang, X.; Xu, X.; et al. RBMDC-Net: Effective Jaw Cyst Segmentation Network Using Residual Bottleneck and Multiscale Dilated Convolution. IEEE Access 2025, 13, 3683–3695. https://doi.org/10.1109/access.2024.3525408.

  • 29.

    Al-Dhabyani, W.; Gomaa, M.; Khaled, H.; et al. Deep Learning Approaches for Data Augmentation and Classification of Breast Masses Using Ultrasound Images. Int. J. Adv. Comput. Sci. Appl. 2019, 10, 1–11. https://doi.org/10.14569/ijacsa.2019.0100579.

  • 30.

    Codella, N.C.F.; Gutman, D.; Celebi, M.E.; et al. Skin Lesion Analysis toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC). In Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA, 4–7 April 2018; pp. 168–172. https://doi.org/10.1109/isbi.2018.8363547.

  • 31.

    Wang, Y.; Han, W.; Peng, H.; et al. SAM-SS: Straightforward and Efficient Designs Based on Segment Anything Model for Semantic Segmentation. IEEE Trans. Comput. Soc. Syst. 2026, 13, 5323–5331. https://doi.org/10.1109/tcss.2026.3686911.

  • 32.

    Lin, A.; Chen, B.; Xu, J.; et al. DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation. IEEE Trans. Instrum. Meas. 2022, 71, 1–15. https://doi.org/10.1109/tim.2022.3178991.

  • 33.

    Wu, Y.; Wang, Z.; Yang, X.; et al. Trans-SAM: Transfer Segment Anything Model to Medical Image Segmentation with Parameter-Efficient Fine-Tuning. Knowl.-Based Syst. 2025, 310, 112909. https://doi.org/10.1016/j.knosys.2024.112909.

  • 34.

    Xiong, X.; Wu, Z.; Tan, S.; et al. SAM2-UNet: Segment Anything 2 Makes Strong Encoder for Natural and Medical Image Segmentation. Vis. Intell. 2026, 4, 2. https://doi.org/10.1007/s44267-025-00106-w.

  • 35.

    Feng, S.; Zhao, H.; Shi, F.; et al. CPFNet: Context Pyramid Fusion Network for Medical Image Segmentation. IEEE Trans. Med. Imaging 2020, 39, 3008–3018. https://doi.org/10.1109/tmi.2020.2983721.

  • 36.

    Gu, R.; Wang, G.; Song, T.; et al. CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentation. IEEE Trans. Med. Imaging 2021, 40, 699–711. https://doi.org/10.1109/tmi.2020.3035253.

  • 37.

    Gu, Z.; Cheng, J.; Fu, H.; et al. CE-Net: Context Encoder Network for 2D Medical Image Segmentation. IEEE Trans. Med. Imaging 2019, 38, 2281–2292. https://doi.org/10.1109/tmi.2019.2903562.

  • 38.

    Chen, G.; Li, L.; Dai, Y.; et al. AAU-Net: An Adaptive Attention U-Net for Breast Lesions Segmentation in Ultrasound Images. IEEE Trans. Med. Imaging 2023, 42, 1289–1300. https://doi.org/10.1109/tmi.2022.3226268.

  • 39.

    Zheng, S.; Lu, J.; Zhao, H.; et al. Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers. In Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 20–25 June 2021; pp. 6877–6886. https://doi.org/10.1109/cvpr46437.2021.00681.

  • 40.

    Huang, X.; Deng, Z.; Li, D.; et al. MISSFormer: An Effective Medical Image Segmentation Transformer. arXiv 2021, arXiv:2109.07162.

  • 41.

    Zhang, Y.; Liu, H.; Hu, Q. TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation. In Lecture Notes in Computer Science, Proceedings of the Medical Image Computing and Computer Assisted Intervention—MICCAI 2021, Strasbourg, France, 27 September–1 October 2021; Springer: Cham, Switzerland, 2021; pp. 14–24. https://doi.org/10.1007/978-3-030-87193-2_2.

  • 42.

    Wu, H.; Chen, S.; Chen, G.; et al. FAT-Net: Feature Adaptive Transformers for Automated Skin Lesion Segmentation. Med. Image Anal. 2022, 76, 102327. https://doi.org/10.1016/j.media.2021.102327.

Share this article:
How to Cite
Li, C.; Rao, Z.; Tang, T.; Wang, Z.; Wang, Y.; Pan, X. From Fully-Automatic to Efficient Interaction: A Lightweight Prompting Framework for Jaw Cyst Segmentation. Transactions on Artificial Intelligence 2026, 2 (1), 231–244. https://doi.org/10.53941/tai.2026.100015.
RIS
BibTex
Copyright & License
article copyright Image
Copyright (c) 2026 by the authors.
Article Metrics
109
Article Views
0
Citations