Dunhuang murals contour generation network based on convolution and self-attention fusion

被引:1
|
作者
Liu, Baokai [1 ]
He, Fengjie [2 ]
Du, Shiqiang [1 ,3 ]
Zhang, Kaiwu [1 ]
Wang, Jianhua [1 ]
机构
[1] Northwest Minzu Univ, Chinese Natl Informat Technol Res Inst, Key Lab Chinas Ethn Languages & Informat Technol, Minist Educ, Lanzhou 730030, Gansu, Peoples R China
[2] China Mobile Grp Design Inst Co Ltd, Shaanxi Branch, Xian 710000, Shaanxi, Peoples R China
[3] Northwest Minzu Univ, Coll Math & Comp Sci, Lanzhou 730030, Gansu, Peoples R China
关键词
Edge detection; Ramix; Line drawings; Dunhuang murals; EDGE-DETECTION;
D O I
10.1007/s10489-023-04614-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dunhuang murals are a collection of Chinese style and national style, forming an autonomous Chinese-style Buddhist art. It has a very great historical and cultural value and an important research value. Among them, the lines of Dunhuang murals are extremely general and expressive. It reflects the character's distinct character and intricate inner emotions. Hence, the outline drawing of the murals is of great importance in search of the Dunhuang culture. The generation of contours of Dunhuang murals belongs to the detection of image contours, which is an important branch of computer vision, aimed at extract salient contour information from the images. Although convolution-based deep learning networks have achieved good results in extracting image contours by exploring the contextual and semantic features of images. However, as the receptive field broadens, some detailed local information is lost. As a result, it is impossible for them to generate reasonable outline drawings of murals. In this paper, we propose a novel edge detector based on self-attention combined with convolution to generate line drawings of Dunhuang murals. Compared with existing edge detection methods, firstly, a new residual self-attention and convolution mixed module(Ramix) is proposed to merge local and global features into feature maps. Secondly, a novel densely connected backbone extraction network is designed to efficiently propagate information rich in edge features from shallow layers into deep layers. It is apparent from the experimental results that the method of this paper can generate richer and sharper edge maps on several standard edge detection datasets. In addition, tests on the Dunhuang mural dataset show that our method can achieve very competitive performance.
引用
收藏
页码:22073 / 22085
页数:13
相关论文
共 50 条
  • [21] Cloudformer: A Cloud-Removal Network Combining Self-Attention Mechanism and Convolution
    Wu, Peiyang
    Pan, Zongxu
    Tang, Hairong
    Hu, Yuxin
    REMOTE SENSING, 2022, 14 (23)
  • [22] A Self-Attention Legendre Graph Convolution Network for Rotating Machinery Fault Diagnosis
    Ma, Jiancheng
    Huang, Jinying
    Liu, Siyuan
    Luo, Jia
    Jing, Licheng
    SENSORS, 2024, 24 (17)
  • [23] Infrared Small Target Detection Based on Fusion Full Convolutional Network and Self-Attention
    Duan, Peipei
    Zhang, Yan
    SECOND IYSF ACADEMIC SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND COMPUTER ENGINEERING, 2021, 12079
  • [24] Electrocardiogram signal classification based on fusion method of residual network and self-attention mechanism
    Yuan C.
    Liu Z.
    Wang C.
    Yang F.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2023, 40 (03): : 474 - 481
  • [25] Multi-stage Feature Fusion Network for Edge Detection of Dunhuang Murals
    Wang, Jianhua
    Liu, Baokai
    Li, Jiacheng
    Liu, Wenjie
    Du, Shiqiang
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4684 - 4689
  • [26] A self-attention dynamic graph convolution network model for traffic flow prediction
    Liao, Kaili
    Zhou, Wuneng
    Wu, Wanpeng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [27] Recursive Self-Attention Modules-Based Network for Panchromatic and Multispectral Image Fusion
    Liu, Chuang
    Wei, Lu
    Zhang, Zhiqi
    Feng, Xiaoxiao
    Xiang, Shao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 10067 - 10083
  • [28] Self-Attention and Convolution Fusion Network for Land Cover Change Detection over a New Data Set in Wenzhou, China
    Zhu, Yiqun
    Jin, Guojian
    Liu, Tongfei
    Zheng, Hanhong
    Zhang, Mingyang
    Liang, Shuang
    Liu, Jieyi
    Li, Linqi
    REMOTE SENSING, 2022, 14 (23)
  • [29] Dialogue Generation Using Self-Attention Generative Adversarial Network
    Hatua, Amartya
    Nguyen, Trung T.
    Sung, Andrew H.
    2019 IEEE INTERNATIONAL CONFERENCE ON CONVERSATIONAL DATA & KNOWLEDGE ENGINEERING (CDKE), 2019, : 33 - 38
  • [30] Interactive Enhanced Network Based on Multihead Self-Attention and Graph Convolution for Classification of Hyperspectral and LiDAR Data
    Gao, Hongmin
    Feng, Hao
    Zhang, Yiyan
    Fei, Shuyu
    Shen, Runhua
    Xu, Shufang
    Zhang, Bing
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62