Multi-guided-based image matting via boundary detection

被引:1
作者
Yao, Guilin [1 ]
Sun, Anming [1 ]
机构
[1] Harbin Univ Commerce, Sch Comp & Informat Engn, Harbin 150028, Peoples R China
关键词
Image matting; Boundary detection; Deep learning; Transformer;
D O I
10.1016/j.cviu.2024.103998
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing automatic matting methods tend to directly obtain the alpha mattes from the RGB image using semantic segmentation networks, and relying solely on segmentation to achieve high -quality estimation is usually unrealistic. To address this issue, we propose a multi -guided -based image matting (MGBMatting) model that utilizes boundary information and semantic features as comprehensive and sufficient guidance, increasing attention to the unknown regions in the trimap, which is often a challenging aspect of matting tasks. The boundary -extracted module we introduced in MGBMatting effectively enhances the boundary features of the foreground. In addition, the boundary optimization module effectively achieves spatial consistency in features as well as enhances the representational power of the features. Further, the dual -stream encoder increases the possibility of capturing both local features and long-range feature dependencies. We use two widely used image matting datasets, Composition -1k and Distinctions -646, to evaluate our MGBMatting. Extensive experimentation demonstrates that the proposed MGBMatting yields significant performance.
引用
收藏
页数:11
相关论文
共 61 条
  • [1] Designing Effective Inter-Pixel Information Flow for Natural Image Matting
    Aksoy, Yagiz
    Aydin, Tunc Ozan
    Pollefeys, Marc
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 228 - 236
  • [2] Berman Arie, 2000, US Patent, Patent No. 6134346
  • [3] Cai HQ, 2023, Arxiv, DOI arXiv:2303.06476
  • [4] KNN Matting
    Chen, Qifeng
    Li, Dingzeyu
    Tang, Chi-Keung
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (09) : 2175 - 2188
  • [5] Semantic Human Matting
    Chen, Quan
    Ge, Tiezheng
    Xu, Yanyu
    Zhang, Zhiqiang
    Yang, Xinxin
    Gai, Kun
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 618 - 626
  • [6] Chen TC, 2009, PROC EUR SOLID-STATE, P1
  • [7] Robust Multi-Focus Image Fusion Using Edge Model and Multi-Matting
    Chen, Yibo
    Guan, Jingwei
    Cham, Wai-Kuen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (03) : 1526 - 1541
  • [8] Automatic Trimap Generation and Consistent Matting for Light-Field Images
    Cho, Donghyeon
    Kim, Sunyeong
    Tai, Yu-Wing
    Kweon, In So
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (08) : 1504 - 1517
  • [9] Natural Image Matting Using Deep Convolutional Neural Networks
    Cho, Donghyeon
    Tai, Yu-Wing
    Kweon, Inso
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 626 - 643
  • [10] Chuang YY, 2001, PROC CVPR IEEE, P264