ASF-YOLO: A novel YOLO model with attentional scale sequence fusion for cell instance segmentation

被引:64
|
作者
Kang, Ming [1 ]
Ting, Chee-Ming [1 ]
Ting, Fung Fung [1 ]
Phan, Raphael C. -W. [1 ]
机构
[1] Monash Univ, Sch Informat Technol, Malaysia Campus, Subang Jaya 47500, Malaysia
关键词
Medical image analysis; Small object segmentation; You only look once (YOLO); Sequence feature fusion; Attention mechanism;
D O I
10.1016/j.imavis.2024.105057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a novel Attentional Scale Sequence Fusion based You Only Look Once (YOLO) framework (ASFYOLO) which combines spatial and scale features for accurate and fast cell instance segmentation. Built on the YOLO segmentation framework, we employ the Scale Sequence Feature Fusion (SSFF) module to enhance the multiscale information extraction capability of the network, and the Triple Feature Encoder (TFE) module to fuse feature maps of different scales to increase detailed information. We further introduce a Channel and Position Attention Mechanism (CPAM) to integrate both the SSFF and TFE modules, which focus on informative channels and spatial position-related small objects for improved detection and segmentation performance. Experimental validations on two cell datasets show remarkable segmentation accuracy and speed of the proposed ASF-YOLO model. It achieves a box mAP of 0.91, mask mAP of 0.887, and an inference speed of 47.3 FPS on the 2018 Data Science Bowl dataset, outperforming the state-of-the-art methods. The source code is available at https://github. com/mkang315/ASF-YOLO.
引用
收藏
页数:9
相关论文
共 27 条
  • [21] RTAU-Net: A novel 3D rectal tumor segmentation model based on dual path fusion and attentional guidance
    Li, Dengao
    Wang, Juan
    Yang, Jicheng
    Zhao, Jumin
    Yang, Xiaotang
    Cui, Yanfen
    Zhang, Kenan
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 242
  • [22] A Novel Hybridoma Cell Segmentation Method Based on Multi-Scale Feature Fusion and Dual Attention Network
    Lu, Jianfeng
    Ren, Hangpeng
    Shi, Mengtao
    Cui, Chen
    Zhang, Shanqing
    Emam, Mahmoud
    Li, Li
    ELECTRONICS, 2023, 12 (04)
  • [23] A novel cell contour-based instance segmentation model and its applications in HER2 breast cancer discrimination
    Ju, Bobo
    Liu, Yang
    Hu, Xing
    Zhao, Dongfang
    Jiang, Linhua
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 85
  • [24] MCIF-Transformer Mask RCNN: Multi-Branch Cross-Scale Interactive Feature Fusion Transformer Model for PET/CT Lung Tumor Instance Segmentation
    Lu, Huiling
    Zhou, Tao
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 79 (03): : 4371 - 4393
  • [25] Multi-Scale Fusion With Matching Attention Model: A Novel Decoding Network Cooperated With NAS for Real-Time Semantic Segmentation
    Xie, Bangquan
    Yang, Zongming
    Yang, Liang
    Luo, Ruifa
    Wei, Ailin
    Weng, Xiaoxiong
    Li, Bing
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) : 12622 - 12632
  • [26] A novel adjunctive diagnostic method for bone cancer: Osteosarcoma cell segmentation based on Twin Swin Transformer with multi-scale feature fusion
    Wen, Tingxi
    Tong, Binbin
    Fu, Yuqing
    Li, Yunfeng
    Ling, Mengde
    Chen, Xinwen
    JOURNAL OF BONE ONCOLOGY, 2024, 49
  • [27] MSRT-DETR: A novel RT-DETR model with multi-scale feature sequence for cell detection
    Zhou, Chuncheng
    He, Haiyang
    Zhou, Hao
    Ge, Fuhua
    Yu, Pengfei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 103