Detection of Photoplethysmography Manipulation in Video Forgery
- Resource Type
- Conference
- Authors
- Lin, Yuzhen; Maiorana, Emanuele; Li, Bin; Campisi, Patrizio
- Source
- 2023 31st European Signal Processing Conference (EUSIPCO) European Signal Processing Conference (EUSIPCO), 2023 31st. :615-619 Sep, 2023
- Subject
- Signal Processing and Analysis
Heart rate
Deepfakes
Visualization
Databases
Forensics
Signal processing
Photoplethysmography
Remote photoplethysmography (rPPG)
Face forgery detection
Video forensics
- Language
- ISSN
- 2076-1465
Recent studies have shown that physiological signals related to blood pressure and heart rate can be estimated in a contactless modality from facial videos using remote photoplethysmography (rPPG). This has paved the way to the development of techniques that can acquire and manipulate the rPPG signals recoverable from facial videos without affecting their visual appearance. The goal of this paper is to analyze the detectability of this new kind of forgery, here referred to as rPPG deepfake videos. Specifically, we propose a two-stream method based on the analysis of rPPG deepfake videos at both spatial and temporal levels. The experimental results obtained from tests performed on samples taken from two distinct databases demonstrate that our method performs better than popular deep learning methods in the rPPG deepfake detection task.