Towards Robust Homography Estimation for Forward-Motion Panorama for Multi-camera Wireless Capsule Endoscopy Videos

被引:0
作者
Oliveira, Marina [1 ]
Araujo, Helder [1 ]
机构
[1] Fac Sci & Technol, Inst Syst & Robot, Dept Elect & Comp Engn, P-3004531 Coimbra, Portugal
来源
BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES, BIOSTEC 2023 | 2024年 / 2079卷
关键词
Capsule movement; Deep learning; Feature-extraction; panorama; Optical flow; Wireless capsule endoscopy; IMAGE;
D O I
10.1007/978-3-031-67088-6_1
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
A noteworthy challenge in Wireless Capsule Endoscopy is the significant time and expertise required by medical professionals to accurately interpret its videos and detect anomalies. The combination of a large number of frames to analyze within each video coupled with poor image quality contributes to low lesion detection rates. To address these issues, our study explores a methodology for the construction of local forward and/or backward-motion panoramic overviews from videos rendered from a synthetic tubular model created in Blender. This approach aims to consolidate essential information from multiple frames for the purpose of lesion detection and localization. The mosaicing process is explored by computing global homographies between sequential frames and three methods for homography estimation are assessed. This study compares the resulting local panoramas obtained with our method with those produced using a deep neural network approach, utilizing three different models for image quality assessment.
引用
收藏
页码:1 / 23
页数:23
相关论文
共 25 条
  • [1] Behrens A, 2008, ACTA POLYTECH, V48, P50
  • [2] Brown A.P., 2020, Arch. Prev. Med., V5, P031
  • [3] Generating panoramic unfolded image from borehole video acquired through APBT
    Cao, Maoyong
    Deng, Zhaopeng
    Rai, Laxmisha
    Teng, Shenghua
    Zhao, Meng
    Collier, Michael
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (19) : 25149 - 25179
  • [4] Ciuti Gastone, 2011, IEEE Rev Biomed Eng, V4, P59, DOI 10.1109/RBME.2011.2171182
  • [5] Figueiredo I.N., 2019, Wireless capsule endoscope location and a robotic validation experiment, P1361
  • [6] Visual Importance and Distortion Guided Deep Image Quality Assessment Framework
    Guan, Jingwei
    Yi, Shuai
    Zeng, Xingyu
    Cham, Wai-Kuen
    Wang, Xiaogang
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (11) : 2505 - 2520
  • [7] Hartley R., 2003, MULTIPLE VIEW GEOMET, DOI 10.1016/S0143-8166(01)00145-2
  • [8] Reduction of capsule endoscopy reading times by unsupervised image mining
    Iakovidis, D. K.
    Tsevas, S.
    Polydorou, A.
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2010, 34 (06) : 471 - 478
  • [9] Jirong Zhang, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P653, DOI 10.1007/978-3-030-58452-8_38
  • [10] Convolutional Neural Networks for No-Reference Image Quality Assessment
    Kang, Le
    Ye, Peng
    Li, Yi
    Doermann, David
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1733 - 1740