Forward stagewise regression with multilevel memristor for sparse coding

被引:3
作者
Wu, Chenxu [1 ]
Xue, Yibai [1 ]
Bao, Han [1 ]
Yang, Ling [1 ]
Li, Jiancong [1 ]
Tian, Jing [1 ]
Ren, Shengguang [1 ]
Li, Yi [1 ,2 ]
Miao, Xiangshui [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Integrated Circuits, Wuhan 430074, Peoples R China
[2] Hubei Yangtze Memory Labs, Wuhan 430205, Peoples R China
基金
国家重点研发计划;
关键词
forward stagewise regression; in-memory computing; memristor; sparse coding; IN-MEMORY CHIP;
D O I
10.1088/1674-4926/44/10/104101
中图分类号
O469 [凝聚态物理学];
学科分类号
070205 ;
摘要
Sparse coding is a prevalent method for image inpainting and feature extraction, which can repair corrupted images or improve data processing efficiency, and has numerous applications in computer vision and signal processing. Recently, several memristor-based in-memory computing systems have been proposed to enhance the efficiency of sparse coding remarkably. However, the variations and low precision of the devices will deteriorate the dictionary, causing inevitable degradation in the accuracy and reliability of the application. In this work, a digital-analog hybrid memristive sparse coding system is proposed utilizing a multilevel Pt/Al2O3/AlOx/W memristor, which employs the forward stagewise regression algorithm: The approximate cosine distance calculation is conducted in the analog part to speed up the computation, followed by high-precision coefficient updates performed in the digital portion. We determine that four states of the aforementioned memristor are sufficient for the processing of natural images. Furthermore, through dynamic adjustment of the mapping ratio, the precision requirement for the digit-to-analog converters can be reduced to 4 bits. Compared to the previous system, our system achieves higher image reconstruction quality of the 38 dB peak-signal-to-noise ratio. Moreover, in the context of image inpainting, images containing 50% missing pixels can be restored with a reconstruction error of 0.0424 root-mean-squared error.
引用
收藏
页数:9
相关论文
共 50 条
  • [11] Optimization Schemes for In-Memory Linear Regression Circuit With Memristor Arrays
    Wang, Shiqing
    Sun, Zhong
    Liu, Yuheng
    Bao, Shengyu
    Cai, Yimao
    Ielmini, Daniele
    Huang, Ru
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2021, 68 (12) : 4900 - 4909
  • [12] A multilevel memristor-CMOS memory cell as a ReRAM
    Rabbani, Payam
    Dehghani, Rasoul
    Shahpari, Nima
    MICROELECTRONICS JOURNAL, 2015, 46 (12) : 1283 - 1290
  • [13] Case study on memristor-based multilevel memories
    Soell, Christopher
    Reichenbach, Marc
    Roeber, Juergen
    Hagelauer, Amelie
    Weigel, Robert
    Fey, Dietmar
    INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS, 2018, 46 (01) : 99 - 112
  • [14] Nonlinear variable selection with continuous outcome: A fully nonparametric incremental forward stagewise approach
    Yu, Tianwei
    STATISTICAL ANALYSIS AND DATA MINING, 2018, 11 (04) : 188 - 197
  • [15] LEARNED CONVOLUTIONAL SPARSE CODING
    Sreter, Hillel
    Giryes, Raja
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2191 - 2195
  • [16] Sparse Coding of Visual Context
    Miao, Jun
    Qing, Laiyun
    Duan, Lijuan
    Chen, Xilin
    Gao, Wen
    ADVANCES IN COGNITIVE NEURODYNAMICS, PROCEEDINGS, 2008, : 891 - +
  • [17] Sparse Coding with Anomaly Detection
    Amir Adler
    Michael Elad
    Yacov Hel-Or
    Ehud Rivlin
    Journal of Signal Processing Systems, 2015, 79 : 179 - 188
  • [18] Sparse Coding with Anomaly Detection
    Adler, Amir
    Elad, Michael
    Hel-Or, Yacov
    Rivlin, Ehud
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2015, 79 (02): : 179 - 188
  • [19] Sparse Spectrotemporal Coding of Sounds
    David J. Klein
    Peter König
    Konrad P. Körding
    EURASIP Journal on Advances in Signal Processing, 2003
  • [20] The problem of sparse image coding
    Pece, AEC
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2002, 17 (02) : 89 - 108