GOMPS: Global Attention-based Ophthalmic Image Measurement and Postoperative Appearance Prediction System

被引:4
作者
Huang, Xingru [1 ,7 ]
Li, Zhi [1 ]
Lou, Lixia [3 ]
Dan, Ruilong [1 ]
Chen, Lingxiao [1 ]
Zeng, Guodong [5 ]
Jia, Gangyong [1 ]
Chen, Xiaodiao [1 ,4 ]
Jin, Qun [6 ]
Ye, Juan [3 ]
Wang, Yaqi [2 ]
机构
[1] Hangzhou Dianzi Univ, Hangzhou 310018, Peoples R China
[2] Commun Univ Zhejiang, Coll Media Engn, Hangzhou 310018, Peoples R China
[3] Zhejiang Univ, Affiliated Hosp 2, Sch Med, Dept Ophthalmol, Hangzhou, Peoples R China
[4] Commun Univ Zhejiang, Key Lab Film & TV Media Technol Zhejiang Prov, Hangzhou 310042, Peoples R China
[5] Univ Bern, Sitem Ctr Translat Med & Biomed Entrepreneurship, Bern, Switzerland
[6] Waseda Univ, Fac Human Sci, Dept Human Informat & Cognit Sci, Tokyo, Japan
[7] Queen Mary Univ London, Sch Elect Engn & Comp Sci, Mile End Rd, London E1 4NS, England
基金
中国国家自然科学基金;
关键词
Ophthalmic image measurement; Postoperative appearance prediction; Global structure awareness; Semantic segmentation; EYELID RETRACTION; LID CONTOUR; BLEPHAROPTOSIS; NETWORK; THICKNESS; DISTANCE; SURGERY;
D O I
10.1016/j.eswa.2023.120812
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate measurements of ophthalmic parameters and postoperative appearance prediction are essential for the diagnosis and treatment of many ophthalmic diseases. Nevertheless, it remains challenging due to (1) inconsistent ophthalmic image sampling standards, including ocular-camera distance, facial angle, and patient number, (2) complicated ocular morphology, such as subconjunctival hemorrhage, ocular movements, lighting effects, and morphological aging. It is difficult for a model to measure parameters and make predictions in variable sampling methods and morphology conditions. Therefore, the Global attention-based Ophthalmic Image Measurement and Postoperative Appearance Prediction System (GOMPS) is proposed, which quantifies ophthalmic image parameters to diagnose disease and simultaneously predict postoperative appearance of blepharoptosis. By perceiving the global structure of the ophthalmic image, GOMPS makes logical inference predictions of the sclera and cornea morphology, to overcome the above difficulties. Concretely, a global attention unit (GAU) and a novel global attention structure-aware network (GASA-Net) are designed to enhance GOMPS's global structure awareness ability to perform logical reasoning. Extensive experimental results on our collected ophthalmic dataset for diagnosis & prediction (OD2P) demonstrate that GOMPS surpasses the state-of-the-art methods in segmentation accuracy and achieves the current optimal performance in measurement and postoperative prediction under many clinical scenes.
引用
收藏
页数:14
相关论文
共 66 条
  • [1] Pix2pix Conditional Generative Adversarial Networks for Scheimpflug Camera Color-Coded Corneal Tomography Image Generation
    Abdelmotaal, Hazem
    Abdou, Ahmed A.
    Omar, Ahmed F.
    El-Sebaity, Dalia Mohamed
    Abdelazeem, Khaled
    [J]. TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2021, 10 (07):
  • [2] Data-based prediction of soft tissue changes after orthognathic surgery: clinical assessment of new simulation software
    Abe, N.
    Kuroda, S.
    Furutani, M.
    Tanaka, E.
    [J]. INTERNATIONAL JOURNAL OF ORAL AND MAXILLOFACIAL SURGERY, 2015, 44 (01) : 90 - 96
  • [3] Analysis of Surgical Outcome After Levator Advancement by Assessing Changes in Eyelid Contour
    Ahn, Somin
    Lee, Hwa
    Lee, Joonsik
    Park, Jinhwan
    Park, Minsoo
    Baek, Sehyun
    [J]. JOURNAL OF CRANIOFACIAL SURGERY, 2016, 27 (05) : 1147 - 1150
  • [4] Recurrent residual U-Net for medical image segmentation
    Alom, Md Zahangir
    Yakopcic, Chris
    Hasan, Mahmudul
    Taha, Tarek M.
    Asari, Vijayan K.
    [J]. JOURNAL OF MEDICAL IMAGING, 2019, 6 (01)
  • [5] Artifacts in Optical Coherence Tomography Angiography
    Anvari, Pasha
    Ashrafkhorasani, Maryam
    Habibi, Abbas
    Falavarjani, Khalil Ghasemi
    [J]. JOURNAL OF OPHTHALMIC & VISION RESEARCH, 2021, 16 (02) : 271 - 286
  • [6] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [7] Boddeti V.N., 2011, BIOMETRICS IJCB 2011, P1
  • [8] A randomized trial of psychological intervention on perioperative anxiety and depression of patients with severe blepharoptosis undergoing autologous fascia lata frontal muscle suspension
    Cai, Haiyan
    Xu, Suhui
    [J]. ANNALS OF PALLIATIVE MEDICINE, 2021, 10 (03) : 3185 - 3193
  • [9] A Comprehensive Survey of Scene Graphs: Generation and Application
    Chang, Xiaojun
    Ren, Pengzhen
    Xu, Pengfei
    Li, Zhihui
    Chen, Xiaojiang
    Hauptmann, Alex
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) : 1 - 26
  • [10] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
    Chen, Liang-Chieh
    Zhu, Yukun
    Papandreou, George
    Schroff, Florian
    Adam, Hartwig
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 833 - 851