Forward stagewise regression with multilevel memristor for sparse coding

被引:3
作者
Wu, Chenxu [1 ]
Xue, Yibai [1 ]
Bao, Han [1 ]
Yang, Ling [1 ]
Li, Jiancong [1 ]
Tian, Jing [1 ]
Ren, Shengguang [1 ]
Li, Yi [1 ,2 ]
Miao, Xiangshui [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Integrated Circuits, Wuhan 430074, Peoples R China
[2] Hubei Yangtze Memory Labs, Wuhan 430205, Peoples R China
基金
国家重点研发计划;
关键词
forward stagewise regression; in-memory computing; memristor; sparse coding; IN-MEMORY CHIP;
D O I
10.1088/1674-4926/44/10/104101
中图分类号
O469 [凝聚态物理学];
学科分类号
070205 ;
摘要
Sparse coding is a prevalent method for image inpainting and feature extraction, which can repair corrupted images or improve data processing efficiency, and has numerous applications in computer vision and signal processing. Recently, several memristor-based in-memory computing systems have been proposed to enhance the efficiency of sparse coding remarkably. However, the variations and low precision of the devices will deteriorate the dictionary, causing inevitable degradation in the accuracy and reliability of the application. In this work, a digital-analog hybrid memristive sparse coding system is proposed utilizing a multilevel Pt/Al2O3/AlOx/W memristor, which employs the forward stagewise regression algorithm: The approximate cosine distance calculation is conducted in the analog part to speed up the computation, followed by high-precision coefficient updates performed in the digital portion. We determine that four states of the aforementioned memristor are sufficient for the processing of natural images. Furthermore, through dynamic adjustment of the mapping ratio, the precision requirement for the digit-to-analog converters can be reduced to 4 bits. Compared to the previous system, our system achieves higher image reconstruction quality of the 38 dB peak-signal-to-noise ratio. Moreover, in the context of image inpainting, images containing 50% missing pixels can be restored with a reconstruction error of 0.0424 root-mean-squared error.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] ACTION RECOGNITION WITH APPROXIMATE SPARSE CODING
    Wang, Yu
    Kato, Lien
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 770 - 774
  • [42] Neural associative memories and sparse coding
    Palm, Guenther
    NEURAL NETWORKS, 2013, 37 : 163 - 169
  • [43] BAYESIAN NEURAL NETWORKS FOR SPARSE CODING
    Kuzin, Danil
    Isupova, Olga
    Mihaylova, Lyudmila
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 2992 - 2996
  • [44] Maximum-margin sparse coding
    Liu, Chien-Liang
    Hsaio, Wen-Hoar
    Xiao, Bin
    Chen, Chun-Yu
    Wu, Wei-Liang
    NEUROCOMPUTING, 2017, 238 : 340 - 350
  • [45] Continuous speech recognition with sparse coding
    Smit, W. J.
    Barnard, E.
    COMPUTER SPEECH AND LANGUAGE, 2009, 23 (02) : 200 - 219
  • [46] Passive LiNbO3 Memristor With Multilevel States for Neuromorphic Computing
    Xie, Qin
    Pan, Xinqiang
    Wang, Yi
    Luo, Wenbo
    Zhao, Zebin
    Tong, Junde
    Yang, Xudong
    Shuai, Yao
    Wu, Chuangui
    Zhang, Wanli
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2024, 71 (10) : 6049 - 6054
  • [47] Language Recognition via Sparse Coding
    Gwon, Youngjune L.
    Campbell, William M.
    Sturim, Douglas
    Kung, H. T.
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 2920 - 2924
  • [48] Classifying chart images with sparse coding
    Gao, Jinglun
    Zhou, Yin
    Barner, Kenneth E.
    COMPRESSIVE SENSING, 2012, 8365
  • [49] Sparse and silent coding in neural circuits
    Lorincz, Andras
    Palotai, Zsolt
    Szirtes, Gabor
    NEUROCOMPUTING, 2012, 79 : 115 - 124
  • [50] Robust sparse coding for subspace learning
    Dai, Xiangguang
    Tao, Yingyin
    Xiong, Jiang
    Feng, Yuming
    ITALIAN JOURNAL OF PURE AND APPLIED MATHEMATICS, 2020, (44): : 986 - 994