HIGH-THROUGHPUT MICROSCOPY IMAGE DEBLURRING WITH GRAPH REASONING ATTENTION NETWORK

被引:0
|
作者
Zhang, Yulun [1 ]
Wei, Donglai [2 ]
Schalek, Richard [3 ]
Wu, Yuelong [3 ]
Turney, Stephen [3 ]
Lichtman, Jeff [3 ]
Pfister, Hanspeter [3 ]
Fu, Yun [4 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] Boston Coll, Chestnut Hill, MA USA
[3] Harvard Univ, Cambridge, MA USA
[4] Northeastern Univ, Boston, MA USA
关键词
Microscopy image; image deblurring; graph reasoning attention network; adversarial training;
D O I
10.1109/ISBI53787.2023.10230473
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-quality (HQ) microscopy images afford more detailed information for modern life science research and quantitative image analyses. However, in practice, HQ microscopy images are not commonly available or suffer from blurring artifacts. Compared with natural images, such low-quality (LQ) microscopy ones often share some visual characteristics: more complex structures, less informative background, and repeating patterns. For natural image deblurring, deep convolutional neural networks (CNNs) achieve promising performance. But they usually suffer from large model sizes, heavy computation costs, or small throughput, which are critical for high-throughput microscopy image deblurring. To address those problems, we collect HQ electron microscopy and histology datasets and propose a graph reasoning attention network (GRAN). Specifically, we treat deep feature points as embedded visual components, build a graph describing the relationship between all pairs of visual components, and perform reasoning in the graph with a graph convolutional network. The reasoning results are then transferred as attention and residual learning is introduced to achieve graph reasoning attention block (GRAB). We conduct extensive experiments to demonstrate the effectiveness of our GRAN.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] High-throughput fluorescence microscopy using multi-frame motion deblurring
    Phillips, Zachary F.
    Dean, Sarah
    Recht, Benjamin
    Waller, Laura
    BIOMEDICAL OPTICS EXPRESS, 2020, 11 (01): : 281 - 300
  • [2] A simple image correction method for high-throughput microscopy
    Coster, Adam D.
    Wichaidit, Chonlarat
    Rajaram, Satwik
    Altschuler, Steven J.
    Wu, Lani F.
    NATURE METHODS, 2014, 11 (06) : 602 - 602
  • [3] A simple image correction method for high-throughput microscopy
    Adam D Coster
    Chonlarat Wichaidit
    Satwik Rajaram
    Steven J Altschuler
    Lani F Wu
    Nature Methods, 2014, 11 : 602 - 602
  • [4] Annotated high-throughput microscopy image sets for validation
    Ljosa, Vebjorn
    Sokolnicki, Katherine L.
    Carpenter, Anne E.
    NATURE METHODS, 2012, 9 (07) : 637 - 637
  • [5] Annotated high-throughput microscopy image sets for validation
    Vebjorn Ljosa
    Katherine L Sokolnicki
    Anne E Carpenter
    Nature Methods, 2012, 9 : 637 - 637
  • [6] High-throughput hyperspectral microscopy
    Gehm, M. E.
    Brady, D. J.
    THREE-DIMENSIONAL AND MULTIDIMENSIONAL MICROSCOPY: IMAGE ACQUISITION AND PROCESSING XIII, 2006, 6090
  • [7] Synthetic images of high-throughput microscopy for validation of image analysis methods
    Lehmussola, Antti
    Ruusuvuori, Pekka
    Selinummi, Jyrki
    Rajala, Tiina
    Yli-Harja, Olli
    PROCEEDINGS OF THE IEEE, 2008, 96 (08) : 1348 - 1360
  • [8] QUANTIFYING IMAGE STRUCTURES IN HIGH-THROUGHPUT MICROSCOPY WITH TOTAL VARIATION FLOW
    Zadeh, Shekoufeh Gorgi
    Hermann, Max
    Merklinger, Elisa
    Schloetel, Jan-Gero
    Schultz, Thomas
    2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, : 381 - 385
  • [9] Correction: Corrigendum: Annotated high-throughput microscopy image sets for validation
    Vebjorn Ljosa
    Katherine L Sokolnicki
    Anne E Carpenter
    Nature Methods, 2013, 10 : 445 - 445
  • [10] Hierarchical graph attention network for temporal knowledge graph reasoning
    Shao, Pengpeng
    He, Jiayi
    Li, Guanjun
    Zhang, Dawei
    Tao, Jianhua
    NEUROCOMPUTING, 2023, 550