Dunhuang murals contour generation network based on convolution and self-attention fusion

被引:1
|
作者
Liu, Baokai [1 ]
He, Fengjie [2 ]
Du, Shiqiang [1 ,3 ]
Zhang, Kaiwu [1 ]
Wang, Jianhua [1 ]
机构
[1] Northwest Minzu Univ, Chinese Natl Informat Technol Res Inst, Key Lab Chinas Ethn Languages & Informat Technol, Minist Educ, Lanzhou 730030, Gansu, Peoples R China
[2] China Mobile Grp Design Inst Co Ltd, Shaanxi Branch, Xian 710000, Shaanxi, Peoples R China
[3] Northwest Minzu Univ, Coll Math & Comp Sci, Lanzhou 730030, Gansu, Peoples R China
关键词
Edge detection; Ramix; Line drawings; Dunhuang murals; EDGE-DETECTION;
D O I
10.1007/s10489-023-04614-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dunhuang murals are a collection of Chinese style and national style, forming an autonomous Chinese-style Buddhist art. It has a very great historical and cultural value and an important research value. Among them, the lines of Dunhuang murals are extremely general and expressive. It reflects the character's distinct character and intricate inner emotions. Hence, the outline drawing of the murals is of great importance in search of the Dunhuang culture. The generation of contours of Dunhuang murals belongs to the detection of image contours, which is an important branch of computer vision, aimed at extract salient contour information from the images. Although convolution-based deep learning networks have achieved good results in extracting image contours by exploring the contextual and semantic features of images. However, as the receptive field broadens, some detailed local information is lost. As a result, it is impossible for them to generate reasonable outline drawings of murals. In this paper, we propose a novel edge detector based on self-attention combined with convolution to generate line drawings of Dunhuang murals. Compared with existing edge detection methods, firstly, a new residual self-attention and convolution mixed module(Ramix) is proposed to merge local and global features into feature maps. Secondly, a novel densely connected backbone extraction network is designed to efficiently propagate information rich in edge features from shallow layers into deep layers. It is apparent from the experimental results that the method of this paper can generate richer and sharper edge maps on several standard edge detection datasets. In addition, tests on the Dunhuang mural dataset show that our method can achieve very competitive performance.
引用
收藏
页码:22073 / 22085
页数:13
相关论文
共 50 条
  • [11] Condensed Convolution Neural Network by Attention over Self-attention for Stance Detection in Twitter
    Zhou, Shengping
    Lin, Junjie
    Tan, Lianzhi
    Liu, Xin
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [12] Lightweight Smoke Recognition Based on Deep Convolution and Self-Attention
    Zhao, Yang
    Wang, Yigang
    Jung, Hoi-Kyung
    Jin, Yongqiang
    Hua, Dan
    Xu, Sen
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [13] Keyphrase Generation Based on Self-Attention Mechanism
    Yang, Kehua
    Wang, Yaodong
    Zhang, Wei
    Yao, Jiqing
    Le, Yuquan
    CMC-COMPUTERS MATERIALS & CONTINUA, 2019, 61 (02): : 569 - 581
  • [14] ISC-TRANSUNET: MEDICAL IMAGE SEGMENTATION NETWORK BASED ON THE INTEGRATION OF SELF-ATTENTION AND CONVOLUTION
    Li, Fang
    Pei, Siyu
    Zhang, Ziqun
    Yang, Fuming
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2023, 23 (09)
  • [15] Cross-domain recommendation of overlapping users based on self-attention graph convolution network
    Xing, Xing
    Wang, Shiqi
    Liu, Jiawen
    Li, Yunxi
    Jia, Zhichun
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4984 - 4988
  • [16] Self-Attention Progressive Network for Infrared and Visible Image Fusion
    Li, Shuying
    Han, Muyi
    Qin, Yuemei
    Li, Qiang
    REMOTE SENSING, 2024, 16 (18)
  • [17] Self-Attention Based Network for Punctuation Restoration
    Wang, Feng
    Chen, Wei
    Yang, Zhen
    Xu, Bo
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 2803 - 2808
  • [18] Global Self-Attention as a Replacement for Graph Convolution
    Hussain, Md Shamim
    Zaki, Mohammed J.
    Subramanian, Dharmashankar
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 655 - 665
  • [19] Pest Identification Based on Fusion of Self-Attention With ResNet
    Hassan, Sk Mahmudul
    Maji, Arnab Kumar
    IEEE ACCESS, 2024, 12 : 6036 - 6050
  • [20] Multimodal Fusion Method Based on Self-Attention Mechanism
    Zhu, Hu
    Wang, Ze
    Shi, Yu
    Hua, Yingying
    Xu, Guoxia
    Deng, Lizhen
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2020, 2020