Medical image analysis;
Small object segmentation;
You only look once (YOLO);
Sequence feature fusion;
Attention mechanism;
D O I:
10.1016/j.imavis.2024.105057
中图分类号:
TP18 [人工智能理论];
学科分类号:
081104 ;
0812 ;
0835 ;
1405 ;
摘要:
We propose a novel Attentional Scale Sequence Fusion based You Only Look Once (YOLO) framework (ASFYOLO) which combines spatial and scale features for accurate and fast cell instance segmentation. Built on the YOLO segmentation framework, we employ the Scale Sequence Feature Fusion (SSFF) module to enhance the multiscale information extraction capability of the network, and the Triple Feature Encoder (TFE) module to fuse feature maps of different scales to increase detailed information. We further introduce a Channel and Position Attention Mechanism (CPAM) to integrate both the SSFF and TFE modules, which focus on informative channels and spatial position-related small objects for improved detection and segmentation performance. Experimental validations on two cell datasets show remarkable segmentation accuracy and speed of the proposed ASF-YOLO model. It achieves a box mAP of 0.91, mask mAP of 0.887, and an inference speed of 47.3 FPS on the 2018 Data Science Bowl dataset, outperforming the state-of-the-art methods. The source code is available at https://github. com/mkang315/ASF-YOLO.
机构:
Taiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Taiyuan Univ Technol, Key Lab Big Data Fus Anal & Applicat Shanxi Prov, Taiyuan, Shanxi, Peoples R China
Taiyuan Univ Technol, Intelligent Percept Engn Technol Ctr Shanxi, Taiyuan, Shanxi, Peoples R ChinaTaiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Li, Dengao
Wang, Juan
论文数: 0引用数: 0
h-index: 0
机构:
Taiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Taiyuan Univ Technol, Key Lab Big Data Fus Anal & Applicat Shanxi Prov, Taiyuan, Shanxi, Peoples R China
Taiyuan Univ Technol, Intelligent Percept Engn Technol Ctr Shanxi, Taiyuan, Shanxi, Peoples R ChinaTaiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Wang, Juan
Yang, Jicheng
论文数: 0引用数: 0
h-index: 0
机构:
Ocean Univ China, Comp Technol, Qingdao 266100, Peoples R ChinaTaiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Yang, Jicheng
Zhao, Jumin
论文数: 0引用数: 0
h-index: 0
机构:
Taiyuan Univ Technol, Coll Informat & Comp, Taiyuan 030024, Peoples R China
Taiyuan Univ Technol, Key Lab Big Data Fus Anal & Applicat Shanxi Prov, Taiyuan, Shanxi, Peoples R China
Taiyuan Univ Technol, Intelligent Percept Engn Technol Ctr Shanxi, Taiyuan, Shanxi, Peoples R ChinaTaiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Zhao, Jumin
Yang, Xiaotang
论文数: 0引用数: 0
h-index: 0
机构:
Shanxi Med Univ, Shanxi Prov Canc Hosp, Dept Radiol, Taiyuan 030013, Peoples R ChinaTaiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Yang, Xiaotang
Cui, Yanfen
论文数: 0引用数: 0
h-index: 0
机构:
Shanxi Med Univ, Shanxi Prov Canc Hosp, Dept Radiol, Taiyuan 030013, Peoples R ChinaTaiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Cui, Yanfen
Zhang, Kenan
论文数: 0引用数: 0
h-index: 0
机构:
Taiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
Taiyuan Univ Technol, Key Lab Big Data Fus Anal & Applicat Shanxi Prov, Taiyuan, Shanxi, Peoples R China
Taiyuan Univ Technol, Intelligent Percept Engn Technol Ctr Shanxi, Taiyuan, Shanxi, Peoples R ChinaTaiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Peoples R China
机构:
Ningxia Med Univ, Sch Med Informat & Engn, Yinchuan 750004, Peoples R ChinaNingxia Med Univ, Sch Med Informat & Engn, Yinchuan 750004, Peoples R China
Lu, Huiling
Zhou, Tao
论文数: 0引用数: 0
h-index: 0
机构:
North Minzu Univ, Sch Comp Sci & Engn, Yinchuan 750021, Peoples R China
North Minzu Univ, State Ethn Affairs Commiss, Key Lab Image & Graph Intelligent Proc, Yinchuan 750021, Peoples R ChinaNingxia Med Univ, Sch Med Informat & Engn, Yinchuan 750004, Peoples R China
机构:
South China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R China
Clemson Univ, Dept Automot Engn, Int Ctr Automot Res CU ICAR, Greenville, SC 29607 USASouth China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R China
Xie, Bangquan
Yang, Zongming
论文数: 0引用数: 0
h-index: 0
机构:
Clemson Univ, Dept Automot Engn, Int Ctr Automot Res CU ICAR, Greenville, SC 29607 USASouth China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R China
Yang, Zongming
Yang, Liang
论文数: 0引用数: 0
h-index: 0
机构:
CUNY City Coll, New York, NY 10031 USASouth China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R China
Yang, Liang
Luo, Ruifa
论文数: 0引用数: 0
h-index: 0
机构:
MOT, Key Technol & Equipments Intelligent Vehicle Infr, Res & Dev Ctr Transport Ind, Shenzhen 518000, Peoples R ChinaSouth China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R China
Luo, Ruifa
论文数: 引用数:
h-index:
机构:
Wei, Ailin
Weng, Xiaoxiong
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R ChinaSouth China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R China
Weng, Xiaoxiong
Li, Bing
论文数: 0引用数: 0
h-index: 0
机构:
Clemson Univ, Dept Automot Engn, Int Ctr Automot Res CU ICAR, Greenville, SC 29607 USASouth China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R China