Cross-modal hybrid architectures for gastrointestinal tract image analysis: A systematic review and futuristic applications

被引:1
作者
Nemani, Praneeth [1 ]
Vadali, Venkata Surya Sundar [2 ]
Medi, Prathistith Raj [3 ]
Marisetty, Ashish [3 ]
Vollala, Satyanarayana [2 ]
Kumar, Santosh [2 ]
机构
[1] Univ Colorado Boulder, Coll Engn & Appl Sci, Boulder, CO 80309 USA
[2] IIIT Naya Raipur, Dept Comp Sci & Engn, Uparwara, India
[3] IIIT Naya Raipur, Dept Data Sci & Artificial Intelligence, Uparwara, India
关键词
Segmentation; CNNs; Transformers; Generative AI; Hybrid architectures; Dataset; GI-Tract; ENDOSCOPIC RESECTION; FEATURE-EXTRACTION; U-NET; SEGMENTATION; DEEP; CHALLENGES; POLYPS; NETWORKS;
D O I
10.1016/j.imavis.2024.105068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This review paper presents an in-depth exploration of gastrointestinal (GI) tract image analysis, particularly emphasizing organ and polyp segmentation. It addresses the inherent challenges posed by the GI tract's complex anatomy and diverse pathologies, which complicate accurate image analysis. Central to this review is the examination of hybrid computational models that integrate convolutional neural networks (CNNs) and Transformers. This synergy enhances the accuracy of segmenting intricate structures in GI tract imaging, marking a significant advancement in the field. A notable contribution of this review is the systematic categorization and analysis of the latest methodologies in organ and polyp segmentation. It provides a comprehensive overview of various techniques, highlighting their strengths and limitations in addressing the specifications of GI tract imaging. This survey serves as a valuable reference for researchers, outlining current practices and offering insights for future innovations. The review also underscores the critical role of extensive and diverse datasets in advancing GI tract image analysis. It stresses the need for high-quality datasets to effectively train and evaluate emerging models, addressing the broad spectrum of GI tract conditions. Moreover, the review delves into the burgeoning area of Generative AI, exploring its potential to enrich datasets and enhance segmentation models. Future developments in GI tract segmentation will focus on refining hybrid CNN-Transformer models and creating larger, more diverse datasets for better model training. Specialized focus on specific segmentation challenges, like polyp and organ segmentation, is anticipated. The field will explore Generative AI applications for innovative segmentation approaches. Collaborative efforts between technologists and clinicians will enhance practical clinical integration and applicability.
引用
收藏
页数:14
相关论文
共 126 条
  • [1] Abbas Q., 2022, J. Intell. Fuzzy Syst., P1
  • [2] Weighting and thresholding-based detail preserving image enhancement of gastrointestinal images with noise suppression
    Abraham, Elizabeth
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 84
  • [3] Multi parallel U-net encoder network for effective polyp image segmentation
    Al Jowair, Hamdan
    Alsulaiman, Mansour
    Muhammad, Ghulam
    [J]. IMAGE AND VISION COMPUTING, 2023, 137
  • [4] SR-AttNet: An Interpretable Stretch-Relax Attention based Deep Neural Network for Polyp Segmentation in Colonoscopy Images
    Alam, Md. Jahin
    Fattah, Shaikh Anowarul
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 160
  • [5] Systematic review of artificial intelligence techniques in the detection and classification of COVID-19 medical images in terms of evaluation and benchmarking: Taxonomy analysis, challenges, future solutions and methodological aspects
    Albahri, O. S.
    Zaidan, A. A.
    Albahri, A. S.
    Zaidan, B. B.
    Abdulkareem, Karrar Hameed
    Al-qaysi, Z. T.
    Alamoodi, A. H.
    Aleesa, A. M.
    Chyad, M. A.
    Alesa, R. M.
    Kem, L. C.
    Lakulu, Muhammad Modi
    Ibrahim, A. B.
    Rashid, Nazre Abdul
    [J]. JOURNAL OF INFECTION AND PUBLIC HEALTH, 2020, 13 (10) : 1381 - 1396
  • [6] Ahmed AMAA, 2020, Arxiv, DOI arXiv:2012.06771
  • [7] A survey of feature extraction and fusion of deep learning for detection of abnormalities in video endoscopy of gastrointestinal-tract
    Ali, Hussam
    Sharif, Muhammad
    Yasmin, Mussarat
    Rehmani, Mubashir Husain
    Riaz, Farhan
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (04) : 2635 - 2707
  • [8] Ali S, 2021, Arxiv, DOI arXiv:2106.04463
  • [9] Going Deep in Medical Image Analysis: Concepts, Methods, Challenges, and Future Directions
    Altaf, Fouzia
    Islam, Syed M. S.
    Akhtar, Naveed
    Janjua, Naeem Khalid
    [J]. IEEE ACCESS, 2019, 7 : 99540 - 99572
  • [10] Aminabee S., 2024, Emerging Technologies for Health Literacy and Medical Practice, P240