Dunhuang murals contour generation network based on convolution and self-attention fusion

被引:1
|
作者
Liu, Baokai [1 ]
He, Fengjie [2 ]
Du, Shiqiang [1 ,3 ]
Zhang, Kaiwu [1 ]
Wang, Jianhua [1 ]
机构
[1] Northwest Minzu Univ, Chinese Natl Informat Technol Res Inst, Key Lab Chinas Ethn Languages & Informat Technol, Minist Educ, Lanzhou 730030, Gansu, Peoples R China
[2] China Mobile Grp Design Inst Co Ltd, Shaanxi Branch, Xian 710000, Shaanxi, Peoples R China
[3] Northwest Minzu Univ, Coll Math & Comp Sci, Lanzhou 730030, Gansu, Peoples R China
关键词
Edge detection; Ramix; Line drawings; Dunhuang murals; EDGE-DETECTION;
D O I
10.1007/s10489-023-04614-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dunhuang murals are a collection of Chinese style and national style, forming an autonomous Chinese-style Buddhist art. It has a very great historical and cultural value and an important research value. Among them, the lines of Dunhuang murals are extremely general and expressive. It reflects the character's distinct character and intricate inner emotions. Hence, the outline drawing of the murals is of great importance in search of the Dunhuang culture. The generation of contours of Dunhuang murals belongs to the detection of image contours, which is an important branch of computer vision, aimed at extract salient contour information from the images. Although convolution-based deep learning networks have achieved good results in extracting image contours by exploring the contextual and semantic features of images. However, as the receptive field broadens, some detailed local information is lost. As a result, it is impossible for them to generate reasonable outline drawings of murals. In this paper, we propose a novel edge detector based on self-attention combined with convolution to generate line drawings of Dunhuang murals. Compared with existing edge detection methods, firstly, a new residual self-attention and convolution mixed module(Ramix) is proposed to merge local and global features into feature maps. Secondly, a novel densely connected backbone extraction network is designed to efficiently propagate information rich in edge features from shallow layers into deep layers. It is apparent from the experimental results that the method of this paper can generate richer and sharper edge maps on several standard edge detection datasets. In addition, tests on the Dunhuang mural dataset show that our method can achieve very competitive performance.
引用
收藏
页码:22073 / 22085
页数:13
相关论文
共 50 条
  • [1] Dunhuang murals contour generation network based on convolution and self-attention fusion
    Baokai Liu
    Fengjie He
    Shiqiang Du
    Kaiwu Zhang
    Jianhua Wang
    Applied Intelligence, 2023, 53 : 22073 - 22085
  • [2] Self-attention Based Multimodule Fusion Graph Convolution Network for Traffic Flow Prediction
    Li, Lijie
    Shao, Hongyang
    Chen, Junhao
    Wang, Ye
    DATA SCIENCE (ICPCSEE 2022), PT I, 2022, 1628 : 3 - 16
  • [3] Neural network based on convolution and self-attention fusion mechanism for plant leaves disease recognition
    Zhao, Yun
    Li, Yang
    Wu, Na
    Xu, Xing
    CROP PROTECTION, 2024, 180
  • [4] On the Integration of Self-Attention and Convolution
    Pan, Xuran
    Ge, Chunjiang
    Lu, Rui
    Song, Shiji
    Chen, Guanfu
    Huang, Zeyi
    Huang, Gao
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 805 - 815
  • [5] SelfGCN: Graph Convolution Network With Self-Attention for Skeleton-Based Action Recognition
    Wu, Zhize
    Sun, Pengpeng
    Chen, Xin
    Tang, Keke
    Xu, Tong
    Zou, Le
    Wang, Xiaofeng
    Tan, Ming
    Cheng, Fan
    Weise, Thomas
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4391 - 4403
  • [6] Bidirectional Temporal Convolution with Self-Attention Network for CTC-Based Acoustic Modeling
    Sun, Jian
    Guo, Wu
    Gu, Bin
    Liu, Yao
    2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 1262 - 1266
  • [7] Self-attention feature fusion network for semantic segmentation
    Zhou, Zhen
    Zhou, Yan
    Wang, Dongli
    Mu, Jinzhen
    Zhou, Haibin
    NEUROCOMPUTING, 2021, 453 : 50 - 59
  • [8] AcFusion: Infrared and Visible Image Fusion Based on Self-Attention and Convolution With Enhanced Information Extraction
    Zhu, Huayi
    Wu, Heshan
    He, Dongmei
    Lan, Rushi
    Liu, Zhenbing
    Pan, Xipeng
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 4155 - 4167
  • [9] The Contrastive Network With Convolution and Self-Attention Mechanisms for Unsupervised Cell Segmentation
    Zhao, Yuhang
    Shao, Xianhao
    Chen, Cai
    Song, Junlin
    Tian, Chongxuan
    Li, Wei
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (12) : 5837 - 5847
  • [10] Self-Attention Graph Convolution Residual Network for Traffic Data Completion
    Zhang, Yong
    Wei, Xiulan
    Zhang, Xinyu
    Hu, Yongli
    Yin, Baocai
    IEEE TRANSACTIONS ON BIG DATA, 2023, 9 (02) : 528 - 541