TT-TSVD: A Multi-modal Tensor Train Decomposition with Its Application in Convolutional Neural Networks for Smart Healthcare

被引:14
作者
Liu, Debin [1 ]
Yang, Laurence T. [1 ,2 ]
Wang, Puming [3 ]
Zhao, Ruonan [4 ]
Zhang, Qingchen [2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, 1037 Guanshan Rd, Wuhan, Peoples R China
[2] St Francis Xavier Univ, Antigonish, NS, Canada
[3] Yunnan Univ, Sch Software, East Outer Ring Rd, Kunming, Yunnan, Peoples R China
[4] Huazhong Univ Sci & Technol, Sch Cyber Sci & Engn, 1037 Guanshan Rd, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Tensor decomposition; convolutional neural network compression; tensor train-tensor singular value decomposition; Medical auxiliary diagnosis;
D O I
10.1145/3491223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Smart healthcare systems are generating a large scale of heterogenous high-dimensional data with complex relationships. It is hard for current methods to analyze such high-dimensional healthcare data. Specifically, the traditional data reduction methods can not keep the correlation among different modalities of data objects, while the latest methods based on tensor singular value decomposition are not effective for data reduction, although they can keep the correlation. This article presents a tensor train-tensor singular value decomposition err-TsvD) algorithm for data reduction. Particularly, the presented algorithm balances the correlation-preservation ability of modalities and data reduction ability by combining the advantages of the train structure of the tensor train decomposition and the association relationship between the tensor singular value decomposition retention mode. Extensive experiments are conducted on the convolutional neural network and the results clearly show that the presented algorithm performs effectively for data reduction with a low-loss classification accuracy; what is more, classification accuracy on medical image dataset has been improved a little.
引用
收藏
页数:17
相关论文
共 30 条
  • [1] [Anonymous], 2016, Ultimate tensorization: Compressing convolutional and fc layers alike
  • [2] FAST MULTILINEAR SINGULAR VALUE DECOMPOSITION FOR STRUCTURED TENSORS
    Badeau, Roland
    Boyer, Remy
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2008, 30 (03) : 1008 - 1021
  • [3] Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer
    Bejnordi, Babak Ehteshami
    Veta, Mitko
    van Diest, Paul Johannes
    van Ginneken, Bram
    Karssemeijer, Nico
    Litjens, Geert
    van der Laak, Jeroen A. W. M.
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2017, 318 (22): : 2199 - 2210
  • [4] SOLVING MULTILINEAR SYSTEMS VIA TENSOR INVERSION
    Brazell, M.
    Li, N.
    Navasca, C.
    Tamon, C.
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2013, 34 (02) : 542 - 570
  • [5] ANALYSIS OF INDIVIDUAL DIFFERENCES IN MULTIDIMENSIONAL SCALING VIA AN N-WAY GENERALIZATION OF ECKART-YOUNG DECOMPOSITION
    CARROLL, JD
    CHANG, JJ
    [J]. PSYCHOMETRIKA, 1970, 35 (03) : 283 - &
  • [6] A multilinear singular value decomposition
    De Lathauwer, L
    De Moor, B
    Vandewalle, J
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2000, 21 (04) : 1253 - 1278
  • [7] De Lathauwer L, 1997, Signal Processing Based on Multilinear Algebra
  • [8] Denton E, 2014, ADV NEUR IN, V27
  • [9] Fuzzy Detection System for Rumors Through Explainable Adaptive Learning
    Guo, Zhiwei
    Yu, Keping
    Jolfaei, Alireza
    Bashir, Ali Kashif
    Almagrabi, Alaa Omran
    Kumar, Neeraj
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2021, 29 (12) : 3650 - 3664
  • [10] PARAFAC - PARALLEL FACTOR-ANALYSIS
    HARSHMAN, RA
    LUNDY, ME
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 1994, 18 (01) : 39 - 72