Conditional-GAN Based Data Augmentation for Deep Learning Task Classifier Improvement Using fNIRS Data

被引:34
作者
Wickramaratne, Sajila D. [1 ]
Mahmud, Md Shaad [1 ]
机构
[1] Univ New Hampshire, Dept Elect & Comp Engn, Durham, NH 03824 USA
来源
FRONTIERS IN BIG DATA | 2021年 / 4卷
关键词
functional near-infrared spectroscopy; deep learning; classification; GAN; CGAN; CNN; STRUCTURAL SIMILARITY; PERFORMANCE;
D O I
10.3389/fdata.2021.659146
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Functional near-infrared spectroscopy (fNIRS) is a neuroimaging technique used for mapping the functioning human cortex. fNIRS can be widely used in population studies due to the technology's economic, non-invasive, and portable nature. fNIRS can be used for task classification, a crucial part of functioning with Brain-Computer Interfaces (BCIs). fNIRS data are multidimensional and complex, making them ideal for deep learning algorithms for classification. Deep Learning classifiers typically need a large amount of data to be appropriately trained without over-fitting. Generative networks can be used in such cases where a substantial amount of data is required. Still, the collection is complex due to various constraints. Conditional Generative Adversarial Networks (CGAN) can generate artificial samples of a specific category to improve the accuracy of the deep learning classifier when the sample size is insufficient. The proposed system uses a CGAN with a CNN classifier to enhance the accuracy through data augmentation. The system can determine whether the subject's task is a Left Finger Tap, Right Finger Tap, or Foot Tap based on the fNIRS data patterns. The authors obtained a task classification accuracy of 96.67% for the CGAN-CNN combination.
引用
收藏
页数:12
相关论文
共 45 条
[1]   Open-Access fNIRS Dataset for Classification of Unilateral Finger- and Foot-Tapping [J].
Bak, SuJin ;
Park, Jinwoo ;
Shin, Jaeyoung ;
Jeong, Jichai .
ELECTRONICS, 2019, 8 (12)
[2]  
Batra D, 2015, P 4 INT C LEARN REPR
[3]   Consciousness is not a property of states: A reply to Wilberg [J].
Berger, Jacob .
PHILOSOPHICAL PSYCHOLOGY, 2014, 27 (06) :829-842
[4]  
Bergstra J, 2012, J MACH LEARN RES, V13, P281
[5]   Structural similarity quality metrics in a coding context: Exploring the space of realistic distortions [J].
Brooks, Alan C. ;
Zhao, Xiaonan ;
Pappas, Thrasyvoulos N. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (08) :1261-1273
[6]   Deep learning for hybrid EEG-fNIRS brain-computer interface: application to motor imagery classification [J].
Chiarelli, Antonio Maria ;
Croce, Pierpaolo ;
Merla, Arcangelo ;
Zappasodi, Filippo .
JOURNAL OF NEURAL ENGINEERING, 2018, 15 (03)
[7]   INDEPENDENT COMPONENT ANALYSIS, A NEW CONCEPT [J].
COMON, P .
SIGNAL PROCESSING, 1994, 36 (03) :287-314
[8]   Generative Adversarial Networks An overview [J].
Creswell, Antonia ;
White, Tom ;
Dumoulin, Vincent ;
Arulkumaran, Kai ;
Sengupta, Biswa ;
Bharath, Anil A. .
IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) :53-65
[9]   Effective data generation for imbalanced learning using conditional generative adversarial networks [J].
Douzas, Georgios ;
Bacao, Fernando .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 91 :464-471
[10]   A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application [J].
Ferrari, Marco ;
Quaresima, Valentina .
NEUROIMAGE, 2012, 63 (02) :921-935