Multi-scale feature fusion quantum depthwise Convolutional Neural Networks for text classification

被引:0
作者
Chen, Yixiong [1 ]
Fang, Weichuan [2 ]
机构
[1] Beijing Sci & Technol Manager Management Corp, Beijing 100083, Peoples R China
[2] IBM Corp, Dalian 116044, Peoples R China
关键词
Text classification; Quantum Natural Language Processing; Quantum Neural Networks; Quantum depthwise convolution; Quantum embedding; Multi-scale feature fusion;
D O I
10.1016/j.enganabound.2025.106158
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In recent years, with the development of quantum machine learning, Quantum Neural Networks (QNNs) have gained increasing attention in the field of Natural Language Processing (NLP) and have achieved a series of promising results. However, most existing QNN models focus on the architectures of Quantum Recurrent Neural Network (QRNN) and Quantum Self-Attention Mechanism (QSAM). In this work, we propose a novel QNN model based on quantum convolution. We develop the quantum depthwise convolution that significantly reduces the number of parameters and lowers computational complexity. We also introduce the multi-scale feature fusion mechanism to enhance model performance by integrating word-level and sentence-level features. Additionally, we propose the quantum word embedding and quantum sentence embedding, which provide embedding vectors more efficiently. Through experiments on two benchmark text classification datasets, we demonstrate our model outperforms a wide range of state-of-the-art QNN models. Notably, our model achieves anew state-of-the-art test accuracy of 96.77% on the RP dataset. We also show the advantages of our quantum model over its classical counterparts in its ability to improve test accuracy using fewer parameters. Finally, an ablation test confirms the effectiveness of the multi-scale feature fusion mechanism and quantum depthwise convolution in enhancing model performance.
引用
收藏
页数:13
相关论文
共 87 条
  • [1] Detection of anomaly in surveillance videos using quantum convolutional neural networks
    Amin, Javaria
    Anjum, Muhammad Almas
    Ibrar, Kainat
    Sharif, Muhammad
    Kadry, Seifedine
    Crespo, Ruben Gonzalez
    [J]. IMAGE AND VISION COMPUTING, 2023, 135
  • [2] Pest Localization Using YOLOv5 and Classification Based on Quantum Convolutional Network
    Amin, Javeria
    Anjum, Muhammad Almas
    Zahra, Rida
    Sharif, Muhammad Imran
    Kadry, Seifedine
    Sevcik, Lukas
    [J]. AGRICULTURE-BASEL, 2023, 13 (03):
  • [3] 2023, Arxiv, DOI [arXiv:2303.08774, 10.48550/arXiv.2303.08774, DOI 10.48550/ARXIV.2303.08774]
  • [4] Bausch J, 2020, ADV NEUR IN, V33
  • [5] A generative modeling approach for benchmarking and training shallow quantum circuits
    Benedetti, Marcello
    Garcia-Pintos, Delfina
    Perdomo, Oscar
    Leyton-Ortega, Vicente
    Nam, Yunseong
    Perdomo-Ortiz, Alejandro
    [J]. NPJ QUANTUM INFORMATION, 2019, 5 (1)
  • [6] Bergholm V, 2022, Arxiv, DOI [arXiv:1811.04968, DOI 10.48550/ARXIV.1811.04968, 10.48550/arXiv.1811.04968]
  • [7] Noisy intermediate-scale quantum algorithms
    Bharti, Kishor
    Cervera-Lierta, Alba
    Kyaw, Thi Ha
    Haug, Tobias
    Alperin-Lea, Sumner
    Anand, Abhinav
    Degroote, Matthias
    Heimonen, Hermanni
    Kottmann, Jakob S.
    Menke, Tim
    Mok, Wai-Keong
    Sim, Sukin
    Kwek, Leong-Chuan
    Aspuru-Guzik, Alan
    [J]. REVIEWS OF MODERN PHYSICS, 2022, 94 (01)
  • [8] Quantum machine learning
    Biamonte, Jacob
    Wittek, Peter
    Pancotti, Nicola
    Rebentrost, Patrick
    Wiebe, Nathan
    Lloyd, Seth
    [J]. NATURE, 2017, 549 (7671) : 195 - 202
  • [9] Bian H, 2023, arXiv
  • [10] Bouakba Y, 2022, INT C ART INT THEOR, P215