Februus: Input Purification Defense Against Trojan Attacks on Deep Neural Network Systems

被引:166
作者
Doan, Bao Gia [1 ]
Abbasnejad, Ehsan [1 ]
Ranasinghe, Damith C. [1 ]
机构
[1] Univ Adelaide, Adelaide, SA, Australia
来源
36TH ANNUAL COMPUTER SECURITY APPLICATIONS CONFERENCE (ACSAC 2020) | 2020年
关键词
Trojan attacks on Neural Networks; Backdoor Attack Defenses;
D O I
10.1145/3427228.3427264
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose Februus; a new idea to neutralize highly potent and insidious Trojan attacks on Deep Neural Network (DNN) systems at run-time. In Trojan attacks, an adversary activates a backdoor crafted in a deep neural network model using a secret trigger, a Trojan, applied to any input to alter the model's decision to a target prediction-a target determined by and only known to the attacker. Februus sanitizes the incoming input by surgically removing the potential trigger artifacts and restoring the input for the classification task. Februus enables effective Trojan mitigation by sanitizing inputs with no loss of performance for sanitized inputs, Trojaned or benign. Our extensive evaluations on multiple infected models based on four popular datasets across three contrasting vision applications and trigger types demonstrate the high efficacy of Februus. We dramatically reduced attack success rates from 100% to near 0% for all cases (achieving 0% on multiple cases) and evaluated the generalizability of Februus to defend against complex adaptive attacks; notably, we realized the first defense against the advanced partial Trojan attack. To the best of our knowledge, Februus is the first backdoor defense method for operation at run-time capable of sanitizing Trojaned inputs without requiring anomaly detection methods, model retraining or costly labeled data.
引用
收藏
页码:897 / 912
页数:16
相关论文
共 52 条
[1]  
[Anonymous], 2009, LEARNING MULTIPLE LA
[2]  
[Anonymous], 2015, VERY DEEP CONVOLUTIO
[3]  
[Anonymous], Gradientzoo: Pre-trained neural network models
[4]  
[Anonymous], 2016, Amazon Machine Learning
[5]   Medical Image Analysis using Convolutional Neural Networks: A Review [J].
Anwar, Syed Muhammad ;
Majid, Muhammad ;
Qayyum, Adnan ;
Awais, Muhammad ;
Alnowami, Majdi ;
Khan, Muhammad Khurram .
JOURNAL OF MEDICAL SYSTEMS, 2018, 42 (11)
[6]  
ARO, BROAD AGENCY ANNOUNC
[7]  
Bagdasaryan E, 2020, PR MACH LEARN RES, V108, P2938
[8]  
Bagdasaryan Eugene, 2020, ARXIV200503823CSCR
[9]  
Bvlc, CAFFE MODEL ZOO
[10]   VGGFace2: A dataset for recognising faces across pose and age [J].
Cao, Qiong ;
Shen, Li ;
Xie, Weidi ;
Parkhi, Omkar M. ;
Zisserman, Andrew .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :67-74