Online dictionary learning for Local Coordinate Coding with Locality Coding Adaptors

被引:3
作者
Pang, Junbiao [1 ]
Zhang, Chunjie [2 ]
Qin, Lei [3 ]
Zhang, Weigang [4 ]
Qing, Laiyun [2 ]
Huang, Qingming [1 ,2 ,3 ]
Yin, Baocai [1 ]
机构
[1] Beijing Univ Technol, Coll Metropolitan Transportat, Beijing Key Lab Multimedia & Intelligent Software, Beijing 100124, Peoples R China
[2] Univ Chinese Acad Sci, Sch Comp & Control Engn, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[4] Harbin Inst Technol, Sch Comp Sci & Technol, Weihai 26209, Peoples R China
基金
北京市自然科学基金;
关键词
Local Coordinate Coding; Surrogate function; Locality Coding Adaptor; Large scale problem; Online training; SPARSE; RECOGNITION;
D O I
10.1016/j.neucom.2015.01.035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dictionary in Local Coordinate Coding (LCC) is important to approximate a non-linear function with linear ones. Optimizing dictionary from predefined coding schemes is a challenge task. This paper focuses on learning dictionary from two Locality Coding Adaptors (LCAs), i.e., locality Gaussian Adaptor (GA) and locality Euclidean Adaptor (EA), for large-scale and high-dimension datasets. Online dictionary learning is formulated as two cycling steps, local coding and dictionary updating. Both stages scale up gracefully to large-scale datasets with millions of data. The experiments on different applications demonstrate that our method leads to a faster dictionary learning than the classical ones or the state-of-the-art methods. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:61 / 69
页数:9
相关论文
共 28 条
  • [1] [Anonymous], 1999, Nonlinear Programming
  • [2] [Anonymous], 2013, Introductory lectures on convex optimization: A basic course
  • [3] [Anonymous], 1998, ONLINE ALGORITHMS ST
  • [4] [Anonymous], 2008, Advances in neural information processing systems
  • [5] [Anonymous], 2009, Advances in Neural Information Processing Systems
  • [6] [Anonymous], 2006, Advances in Neural Information Processing Systems
  • [7] DONOHO DL, TECHNICAL REPORT
  • [8] Everingham M., 2007, The PASCAL visual object classes challenge 2007 (VOC2007) Results
  • [9] Laplacian Sparse Coding, Hypergraph Laplacian Sparse Coding, and Applications
    Gao, Shenghua
    Tsang, Ivor Wai-Hung
    Chia, Liang-Tien
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) : 92 - 104
  • [10] A DATABASE FOR HANDWRITTEN TEXT RECOGNITION RESEARCH
    HULL, JJ
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1994, 16 (05) : 550 - 554