Multi-scale feature fusion quantum depthwise Convolutional Neural Networks for text classification

被引:0
作者
Chen, Yixiong [1 ]
Fang, Weichuan [2 ]
机构
[1] Beijing Sci & Technol Manager Management Corp, Beijing 100083, Peoples R China
[2] IBM Corp, Dalian 116044, Peoples R China
关键词
Text classification; Quantum Natural Language Processing; Quantum Neural Networks; Quantum depthwise convolution; Quantum embedding; Multi-scale feature fusion;
D O I
10.1016/j.enganabound.2025.106158
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In recent years, with the development of quantum machine learning, Quantum Neural Networks (QNNs) have gained increasing attention in the field of Natural Language Processing (NLP) and have achieved a series of promising results. However, most existing QNN models focus on the architectures of Quantum Recurrent Neural Network (QRNN) and Quantum Self-Attention Mechanism (QSAM). In this work, we propose a novel QNN model based on quantum convolution. We develop the quantum depthwise convolution that significantly reduces the number of parameters and lowers computational complexity. We also introduce the multi-scale feature fusion mechanism to enhance model performance by integrating word-level and sentence-level features. Additionally, we propose the quantum word embedding and quantum sentence embedding, which provide embedding vectors more efficiently. Through experiments on two benchmark text classification datasets, we demonstrate our model outperforms a wide range of state-of-the-art QNN models. Notably, our model achieves anew state-of-the-art test accuracy of 96.77% on the RP dataset. We also show the advantages of our quantum model over its classical counterparts in its ability to improve test accuracy using fewer parameters. Finally, an ablation test confirms the effectiveness of the multi-scale feature fusion mechanism and quantum depthwise convolution in enhancing model performance.
引用
收藏
页数:13
相关论文
共 87 条
[51]   Quantum circuit learning [J].
Mitarai, K. ;
Negoro, M. ;
Kitagawa, M. ;
Fujii, K. .
PHYSICAL REVIEW A, 2018, 98 (03)
[52]   Approximate complex amplitude encoding algorithm and its application to data classification problems [J].
Mitsuda, Naoki ;
Ichimura, Tatsuhiro ;
Nakaji, Kouhei ;
Suzuki, Yohichi ;
Tanaka, Tomoki ;
Raymond, Rudy ;
Tezuka, Hiroyuki ;
Onodera, Tamiya ;
Yamamoto, Naoki .
PHYSICAL REVIEW A, 2024, 109 (05)
[53]   Approximate amplitude encoding in shallow parameterized quantum circuits and its application to financial market indicators [J].
Nakaji, Kouhei ;
Uno, Shumpei ;
Suzuki, Yohichi ;
Raymond, Rudy ;
Onodera, Tamiya ;
Tanaka, Tomoki ;
Tezuka, Hiroyuki ;
Mitsuda, Naoki ;
Yamamoto, Naoki .
PHYSICAL REVIEW RESEARCH, 2022, 4 (02)
[54]   Time-warping invariant quantum recurrent neural networks via quantum-classical adaptive gating [J].
Nikoloska, Ivana ;
Simeone, Osvaldo ;
Banchi, Leonardo ;
Velickovic, Petar .
MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2023, 4 (04)
[55]   Quantum angle encoding with learnable rotation applied to quantum-classical convolutional neural networks [J].
Ovalle-Magallanes, Emmanuel ;
Alvarado-Carrillo, Dora E. ;
Avina-Cervantes, Juan Gabriel ;
Cruz-Aceves, Ivan ;
Ruiz-Pinales, Jose .
APPLIED SOFT COMPUTING, 2023, 141
[56]   Hybrid classical-quantum Convolutional Neural Network for stenosis detection in X-ray coronary angiography [J].
Ovalle-Magallanes, Emmanuel ;
Gabriel Avina-Cervantes, Juan ;
Cruz-Aceves, Ivan ;
Ruiz-Pinales, Jose .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 189
[57]   Quantum machine learning for natural language processing application [J].
Pandey, Shyambabu ;
Basisth, Nihar Jyoti ;
Sachan, Tushar ;
Kumari, Neha ;
Pakray, Partha .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2023, 627
[58]   Absence of Barren Plateaus in Quantum Convolutional Neural Networks [J].
Pesah, Arthur ;
Cerezo, M. ;
Wang, Samson ;
Volkoff, Tyler ;
Sornborger, Andrew T. ;
Coles, Patrick J. .
PHYSICAL REVIEW X, 2021, 11 (04)
[59]  
Radford Alec, 2019, OpenAI blog, V1, P9, DOI DOI 10.4018/978-1-5225-9348-5.CH006
[60]  
Raffel C, 2020, J MACH LEARN RES, V21