Reference : Leveraging High-Frequency Components for Deepfake Detection
Scientific journals : Article
Engineering, computing & technology : Computer science
Security, Reliability and Trust
http://hdl.handle.net/10993/48389
Leveraging High-Frequency Components for Deepfake Detection
English
Mejri, Nesryne mailto [University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > CVI2 >]
Papadopoulos, Konstantinos mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > CVI2 >]
Aouada, Djamila mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > CVI2 >]
8-Oct-2021
IEEE Workshop on Multimedia Signal Processing
IEEE
Yes
International
2163-3517
2473-3628
Tampere
Finland
[en] Deepfake detection ; High-frequency components ; Computer Vision
[en] In the past years, RGB-based deepfake detection has shown notable progress thanks to the development of effective deep neural networks. However, the performance of deepfake detectors remains primarily dependent on the quality of the forged content and the level of artifacts introduced by the forgery method. To detect these artifacts, it is often necessary to separate and analyze the frequency components of an image. In this context, we propose to utilize the high-frequency components of color images by introducing an end-to-end trainable module that (a) extracts features from high-frequency components and (b) fuses them with the features of the RGB input. The module not only exploits the high-frequency anomalies present in manipulated images but also can be used with most RGB-based deepfake detectors. Experimental results show that the proposed approach boosts the performance of state-of-the-art networks,
such as XceptionNet and EfficientNet, on a challenging deepfake dataset.
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Computer Vision Imaging & Machine Intelligence (CVI²)
Researchers ; Professionals ; Students
http://hdl.handle.net/10993/48389
10.1109/MMSP53017.2021.9733606
https://ieeexplore.ieee.org/document/9733606

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Open access
2021165667.pdfAuthor postprint2.41 MBView/Open

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.