Analyzing facial temporal patterns for face anti-spoofing

Jingtian Xia, Siyang Song, Yan Tang, Linlin Shen

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

Abstract

Face anti-spoofing is crucial as face recognition systems are widely challenged by the print attack and replay attack. Since facial temporal patterns of these attacks and real face are naturally different, this paper proposes two temporal modelling approaches to face anti-spoofing tasks. Firstly, we propose to analyze the temporal patterns of mid-level facial attributes in spectral domain, aiming to find the unique frequency patterns of real face and each attack, respectively. Then, we propose to directly model dynamics from the given data, by employing the dynamic image algorithm to generate low-level spatiotemporal representations of videos. In particular, we extract deep features from both global and local face parts, i.e. eyes, nose and mouth, and then fuse them for face spoofing detection. Then, a Convolutional Neural Networks (CNN) - Long Short-Term Memory (LSTM) units (CNN-LSTM) architecture is introduced to learn the high-level spatiotemporal features from dynamic facial images. The proposed approaches were evaluated on two benchmark databases. The results suggest the effectiveness of the second approaches, i.e. as low as 1.85% Equal Error Rate (EER) on CASIA-FASD and 0.00% Average Classification Error Rate (ACER) on REPLAY-ATTACK have been achieved.

Original languageEnglish
Title of host publicationICCPR 2020 - Proceedings of 2020 9th International Conference on Computing and Pattern Recognition
PublisherAssociation for Computing Machinery
Pages200-207
Number of pages8
ISBN (Electronic)9781450387835
DOIs
Publication statusPublished - 30 Oct 2020
Externally publishedYes
Event9th International Conference on Computing and Pattern Recognition, ICCPR 2020 - Virtual, Online, China
Duration: 30 Oct 20201 Nov 2020

Publication series

NameACM International Conference Proceeding Series

Conference

Conference9th International Conference on Computing and Pattern Recognition, ICCPR 2020
Country/TerritoryChina
CityVirtual, Online
Period30/10/201/11/20

Keywords

  • Convolutional neural networks
  • Dynamic image
  • Face anti-spoofing
  • Fourier transform
  • Long short-term memory

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Analyzing facial temporal patterns for face anti-spoofing'. Together they form a unique fingerprint.

Cite this