Reference : Requirements And Threat Models of Adversarial Attacks and Robustness of Chest X-ray c...
E-prints/Working papers : First made available on ORBilu
Engineering, computing & technology : Computer science
Human health sciences : Radiology, nuclear medicine & imaging
Systems Biomedicine; Security, Reliability and Trust
http://hdl.handle.net/10993/48411
Requirements And Threat Models of Adversarial Attacks and Robustness of Chest X-ray classification
English
Ghamizi, Salah mailto [University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS) >]
Cordy, Maxime mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal >]
Papadakis, Mike mailto [University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS) >]
Le Traon, Yves mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal >]
Oct-2021
Yes
[en] Chest
[en] Vulnerability to adversarial attacks is a well-known weakness of Deep Neural Networks. While most of the studies focus on natural images with standardized benchmarks like ImageNet and CIFAR, little research has considered real world applications, in particular in the medical domain.

Our research shows that, contrary to previous claims, robustness of chest x-ray classification is much harder to evaluate and leads to very different assessments based on the dataset, the architecture and robustness metric. We argue that previous studies did not take into account the peculiarity of medical diagnosis, like the co-occurrence of diseases, the disagreement of labellers (domain experts), the threat model of the attacks and the risk implications for each successful attack.

In this paper, we discuss the methodological foundations, review the pitfalls and best practices, and suggest new methodological considerations for evaluating the robustness of chest xray classification models. Our evaluation on 3 datasets, 7 models, and 18 diseases is the largest evaluation of robustness of chest x-ray classification models. We believe our findings will provide reliable guidelines for realistic evaluation and improvement of the robustness of machine learning models for medical diagnosis.
http://hdl.handle.net/10993/48411

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Limited access
AAAI22_ADvMedical.pdfAuthor preprint444.93 kBRequest a copy

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.