Rethinking Certification for Trustworthy Machine-Learning-Based Applications

被引:4
作者
Anisetti, Marco [1 ]
Ardagna, Claudio A. [1 ]
Bena, Nicola [1 ]
Damiani, Ernesto [1 ]
机构
[1] Univ Milan, I-20133 Milan, Italy
关键词
Certification; Robustness; Data models; Behavioral sciences; Malware; Security; Detectors;
D O I
10.1109/MIC.2023.3322327
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Machine learning (ML) is increasingly used to implement advanced applications with nondeterministic behavior, which operate on the cloud-edge continuum. The pervasive adoption of ML is urgently calling for assurance solutions to assess applications' nonfunctional properties (e.g., fairness, robustness, and privacy) with the aim of improving their trustworthiness. Certification has been clearly identified by policy makers, regulators, and industrial stakeholders as the preferred assurance technique to address this pressing need. Unfortunately, existing certification schemes are not immediately applicable to nondeterministic applications built on ML models. This article analyzes the challenges and deficiencies of current certification schemes, discusses open research issues, and proposes a first certification scheme for ML-based applications.
引用
收藏
页码:22 / 28
页数:7
相关论文
共 20 条
[1]   Quantum Computer Systems for Scientific Discovery [J].
Alexeev, Yuri ;
Bacon, Dave ;
Brown, Kenneth R. ;
Calderbank, Robert ;
Carr, Lincoln D. ;
Chong, Frederic T. ;
DeMarco, Brian ;
Englund, Dirk ;
Farhi, Edward ;
Fefferman, Bill ;
Gorshkov, Alexey, V ;
Houck, Andrew ;
Kim, Jungsang ;
Kimmel, Shelby ;
Lange, Michael ;
Lloyd, Seth ;
Lukin, Mikhail D. ;
Maslov, Dmitri ;
Maunz, Peter ;
Monroe, Christopher ;
Preskill, John ;
Roetteler, Martin ;
Savage, Martin J. ;
Thompson, Jeff .
PRX QUANTUM, 2021, 2 (01)
[2]  
Anisetti M., 2023, P MEDES
[3]   Multi-Dimensional Certification of Modern Distributed Systems [J].
Anisetti, Marco ;
Ardagna, Claudio Agostino ;
Bena, Nicola .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (03) :1999-2012
[4]   A Methodology for Non-Functional Property Evaluation of Machine Learning Models [J].
Anisetti, Marco ;
Ardagna, Claudio A. ;
Damiani, Ernesto ;
Panero, Paolo G. .
12TH INTERNATIONAL CONFERENCE ON MANAGEMENT OF DIGITAL ECOSYSTEMS, MEDES 2020, 2020, :38-45
[5]   Test-Based Security Certification of Composite Services [J].
Anisetti, Marco ;
Ardagna, Claudio ;
Damiani, Ernesto ;
Polegri, Gianluca .
ACM TRANSACTIONS ON THE WEB, 2019, 13 (01)
[6]   From Security to Assurance in the Cloud: A Survey [J].
Ardagna, Claudio A. ;
Asal, Rasool ;
Damiani, Ernesto ;
Quang Hieu Vu .
ACM COMPUTING SURVEYS, 2015, 48 (01)
[7]   Certified Machine-Learning Models [J].
Damiani, Ernesto ;
Ardagna, Claudio A. .
SOFSEM 2020: THEORY AND PRACTICE OF COMPUTER SCIENCE, 2020, 12011 :3-15
[8]  
European Commission, 2021, 2021/0106(COD)-Proposal for a Regulation of the European Parliament and of the Council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain Union legislative acts
[9]   Towards Dynamic Dependable Systems Through Evidence-Based Continuous Certification [J].
Faqeh, Rasha ;
Fetzer, Christof ;
Hermanns, Holger ;
Hoffmann, Jorg ;
Klauck, Michaela ;
Koehl, Maximilian A. ;
Steinmetz, Marcel ;
Weidenbach, Christoph .
LEVERAGING APPLICATIONS OF FORMAL METHODS, VERIFICATION AND VALIDATION: ENGINEERING PRINCIPLES, ISOLA 2020, PT II, 2020, 12477 :416-439
[10]   AI2: Safety and Robustness Certification of Neural Networks with Abstract Interpretation [J].
Gehr, Timon ;
Mirman, Matthew ;
Drachsler-Cohen, Dana ;
Tsankov, Petar ;
Chaudhuri, Swarat ;
Vechev, Martin .
2018 IEEE SYMPOSIUM ON SECURITY AND PRIVACY (SP), 2018, :3-18