Forward stagewise regression with multilevel memristor for sparse coding

被引:3
作者
Wu, Chenxu [1 ]
Xue, Yibai [1 ]
Bao, Han [1 ]
Yang, Ling [1 ]
Li, Jiancong [1 ]
Tian, Jing [1 ]
Ren, Shengguang [1 ]
Li, Yi [1 ,2 ]
Miao, Xiangshui [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Integrated Circuits, Wuhan 430074, Peoples R China
[2] Hubei Yangtze Memory Labs, Wuhan 430205, Peoples R China
基金
国家重点研发计划;
关键词
forward stagewise regression; in-memory computing; memristor; sparse coding; IN-MEMORY CHIP;
D O I
10.1088/1674-4926/44/10/104101
中图分类号
O469 [凝聚态物理学];
学科分类号
070205 ;
摘要
Sparse coding is a prevalent method for image inpainting and feature extraction, which can repair corrupted images or improve data processing efficiency, and has numerous applications in computer vision and signal processing. Recently, several memristor-based in-memory computing systems have been proposed to enhance the efficiency of sparse coding remarkably. However, the variations and low precision of the devices will deteriorate the dictionary, causing inevitable degradation in the accuracy and reliability of the application. In this work, a digital-analog hybrid memristive sparse coding system is proposed utilizing a multilevel Pt/Al2O3/AlOx/W memristor, which employs the forward stagewise regression algorithm: The approximate cosine distance calculation is conducted in the analog part to speed up the computation, followed by high-precision coefficient updates performed in the digital portion. We determine that four states of the aforementioned memristor are sufficient for the processing of natural images. Furthermore, through dynamic adjustment of the mapping ratio, the precision requirement for the digit-to-analog converters can be reduced to 4 bits. Compared to the previous system, our system achieves higher image reconstruction quality of the 38 dB peak-signal-to-noise ratio. Moreover, in the context of image inpainting, images containing 50% missing pixels can be restored with a reconstruction error of 0.0424 root-mean-squared error.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Defect Consideratons for Robust Sparse Coding Using Memristor Arrays
    Sheridan, Patrick
    Lu, Wei D.
    PROCEEDINGS OF THE 2015 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH 15), 2015, : 137 - 138
  • [2] Forward Stagewise Shrinkage and Addition for High Dimensional Censored Regression
    Guo Z.
    Lu W.
    Li L.
    Statistics in Biosciences, 2015, 7 (2) : 225 - 244
  • [3] Smooth sparse coding via marginal regression for learning sparse representations
    Balasubramanian, Krishnakumar
    Yu, Kai
    Lebanon, Guy
    ARTIFICIAL INTELLIGENCE, 2016, 238 : 83 - 95
  • [4] Regression-based Sparse Coding for Facial Point Detection
    Tan, Shuqiu
    Guo, Chenggang
    Chen, Dongyi
    Huang, Zhiqi
    2016 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV 2016), 2016, : 179 - 182
  • [5] Sparse Topical Coding with Sparse Groups
    Peng, Min
    Xie, Qianqian
    Huang, Jiajia
    Zhu, Jiahui
    Ouyang, Shuang
    Huang, Jimin
    Tian, Gang
    WEB-AGE INFORMATION MANAGEMENT, PT I, 2016, 9658 : 415 - 426
  • [6] Hessian sparse coding
    Zheng, Miao
    Bu, Jiajun
    Chen, Chun
    NEUROCOMPUTING, 2014, 123 : 247 - 254
  • [7] Sparse Coding with Outliers
    Dai, Xiangguang
    Zhang, Keke
    Zhang, Wei
    Xiong, Jiang
    Feng, Yuming
    2019 TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2019, : 246 - 249
  • [8] Robust object tracking based on ridge regression and multi-scale local sparse coding
    Zhiqiang Zhao
    Liwen Xiong
    Zhuolin Mei
    Bin Wu
    Zongmin Cui
    Tianjiang Wang
    Zhijian Zhao
    Multimedia Tools and Applications, 2020, 79 : 785 - 804
  • [9] Robust object tracking based on ridge regression and multi-scale local sparse coding
    Zhao, Zhiqiang
    Xiong, Liwen
    Mei, Zhuolin
    Wu, Bin
    Cui, Zongmin
    Wang, Tianjiang
    Zhao, Zhijian
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (1-2) : 785 - 804
  • [10] Combining sparse coding with structured output regression machine for single image super-resolution
    Tang, Yongliang
    Gong, Weiguo
    Yi, Qiane
    Li, Weihong
    INFORMATION SCIENCES, 2018, 430 : 577 - 598