Long-Range Feature Propagating for Natural Image Matting

被引:18
|
作者
Liu, Qinglin [1 ]
Xie, Haozhe [1 ]
Zhang, Shengping [1 ]
Zhong, Bineng [2 ]
Ji, Rongrong [3 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
[2] Guangxi Normal Univ, Guilin, Peoples R China
[3] Xiamen Univ, Xiamen, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021 | 2021年
基金
中国国家自然科学基金;
关键词
Image matting; Neural network; Feature propagation;
D O I
10.1145/3474085.3475203
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Natural image matting estimates the alpha values of unknown regions in the trimap. Recently, deep learning based methods propagate the alpha values from the known regions to unknown regions according to the similarity between them. However, we find that more than 50% pixels in the unknown regions cannot be correlated to pixels in known regions due to the limitation of small effective reception fields of common convolutional neural networks, which leads to inaccurate estimation when the pixels in the unknown regions cannot be inferred only with pixels in the reception fields. To solve this problem, we propose Long-Range Feature Propagating Network (LFPNet), which learns the long-range context features outside the reception fields for alpha matte estimation. Specifically, we first design the propagating module which extracts the context features from the downsampled image. Then, we present Center-Surround Pyramid Pooling (CSPP) that explicitly propagates the context features from the surrounding context image patch to the inner center image patch. Finally, we use the matting module which takes the image, trimap and context features to estimate the alpha matte. Experimental results demonstrate that the proposed method performs favorably against the state-of-the-art methods on the AlphaMatting and Adobe Image Matting datasets.
引用
收藏
页码:526 / 534
页数:9
相关论文
共 37 条
  • [21] Efficient long-range convolutions for point clouds
    Peng, Yifan
    Lin, Lin
    Ying, Lexing
    Zepeda-Nunez, Leonardo
    JOURNAL OF COMPUTATIONAL PHYSICS, 2023, 473
  • [22] Rotational structures of long-range diatomic molecules
    B. Gao
    The European Physical Journal D - Atomic, Molecular, Optical and Plasma Physics, 2004, 31 : 283 - 289
  • [23] Phase diagram in the quantum XY model with long-range interactions
    J. R. de Sousa
    The European Physical Journal B - Condensed Matter and Complex Systems, 2005, 43 : 93 - 96
  • [24] Modulational instability on triangular dynamical lattices with long-range interactions and dispersion
    M. Stepić
    A. Maluckov
    Lj Hadžievski
    F. Chen
    D. Runde
    D. Kip
    The European Physical Journal B - Condensed Matter and Complex Systems, 2004, 41 : 495 - 501
  • [25] Comprehensive Analysis of Long-Range Connectivity from and to the Posterior Parietal Cortex of the Mouse
    Oh, Seung Wook
    Son, Sook Jin
    Morris, John A.
    Choi, Joon Ho
    Lee, Changkyu
    Rah, Jong-Cheol
    CEREBRAL CORTEX, 2021, 31 (01) : 356 - 378
  • [26] Feature Extraction and Fuzzy-Based Feature Selection Method for Long Range Captured Iris Images
    Deshpande, Anand
    Patavardhan, Prashant P.
    NETWORKING COMMUNICATION AND DATA KNOWLEDGE ENGINEERING, VOL 2, 2018, 4 : 137 - 144
  • [27] Long-range precipitation forecast based on multipole and preceding fluctuations of sea surface temperature
    Wu, Xushu
    Guo, Shenglian
    Qian, Shuni
    Wang, Zhaoli
    Lai, Chengguang
    Li, Jun
    Liu, Pan
    INTERNATIONAL JOURNAL OF CLIMATOLOGY, 2022, 42 (15) : 8024 - 8039
  • [28] Comparison of neural network configurations in the long-range forecast of southwest monsoon rainfall over India
    Snehashish Chakraverty
    Pallavi Gupta
    Neural Computing and Applications, 2008, 17 : 187 - 192
  • [29] Long-range prediction of Indian summer monsoon rainfall using data mining and statistical approaches
    Vathsala, H.
    Koolagudi, Shashidhar G.
    THEORETICAL AND APPLIED CLIMATOLOGY, 2017, 130 (1-2) : 19 - 33
  • [30] Comparison of neural network configurations in the long-range forecast of southwest monsoon rainfall over India
    Chakraverty, Snehashish
    Gupta, Pallavi
    NEURAL COMPUTING & APPLICATIONS, 2008, 17 (02) : 187 - 192