Deep Learning for Face Anti-Spoofing: A Survey

Type: Article

Publication Date: 2022-01-01

Citations: 117

DOI: https://doi.org/10.1109/tpami.2022.3215850

View Chat PDF

Abstract

Face anti-spoofing (FAS) has lately attracted increasing attention due to its vital role in securing face recognition systems from presentation attacks (PAs). As more and more realistic PAs with novel types spring up, early-stage FAS methods based on handcrafted features become unreliable due to their limited representation capacity. With the emergence of large-scale academic datasets in the recent decade, deep learning based FAS achieves remarkable performance and dominates this area. However, existing reviews in this field mainly focus on the handcrafted features, which are outdated and uninspiring for the progress of FAS community. In this paper, to stimulate future research, we present the first comprehensive review of recent advances in deep learning based FAS. It covers several novel and insightful components: 1) besides supervision with binary label (e.g., '0' for bonafide versus '1' for PAs), we also investigate recent methods with pixel-wise supervision (e.g., pseudo depth map); 2) in addition to traditional intra-dataset evaluation, we collect and analyze the latest methods specially designed for domain generalization and open-set FAS; and 3) besides commercial RGB camera, we summarize the deep learning applications under multi-modal (e.g., depth and infrared) or specialized (e.g., light field and flash) sensors. We conclude this survey by emphasizing current open issues and highlighting potential prospects.

Locations

  • IEEE Transactions on Pattern Analysis and Machine Intelligence - View - PDF
  • arXiv (Cornell University) - View - PDF
  • University of Oulu Repository (University of Oulu) - View - PDF
  • PubMed - View

Similar Works

Action Title Year Authors
+ Deep Learning for Face Anti-Spoofing: A Survey 2021 Zitong Yu
Yunxiao Qin
Xiaobai Li
Chenxu Zhao
Zhen Lei
Guoying Zhao
+ PDF Chat Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision 2018 Yaojie Liu
Amin Jourabloo
Xiaoming Liu
+ Deep Learning meets Liveness Detection: Recent Advancements and Challenges 2021 Arian Sabaghi
Marzieh Oghbaie
Kooshan Hashemifard
Mohammad Esmaeil Akbari
+ Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision 2018 Yaojie Liu
Amin Jourabloo
Xiaoming Liu
+ Learn Convolutional Neural Network for Face Anti-Spoofing 2014 Jianwei Yang
Zhen Lei
Stan Z. Li
+ PDF Chat Learning Meta Pattern for Face Anti-Spoofing 2022 Rizhao Cai
Zhi Li
Renjie Wan
Haoliang Li
Yongjian Hu
Alex C. Kot
+ PDF Chat Learning Generalizable and Identity-Discriminative Representations for Face Anti-Spoofing 2020 Xiaoguang Tu
Zheng Ma
Jian Zhao
Guodong Du
Mei Xie
Jiashi Feng
+ Learning deep forest with multi-scale Local Binary Pattern features for face anti-spoofing 2019 Rizhao Cai
Changsheng Chen
+ Learning Facial Liveness Representation for Domain Generalized Face Anti-spoofing 2022 Zih-Ching Chen
Lin-Hsi Tsao
Chin-Lun Fu
Shang‐Fu Chen
Yu-Chiang Frank Wang
+ PDF Chat Learning Facial Liveness Representation for Domain Generalized Face Anti-Spoofing 2022 Zih-Ching Chen
Lin-Hsi Tsao
Chin-Lun Fu
Shang‐Fu Chen
Yu-Chiang Frank Wang
+ PDF Chat FeatherNets: Convolutional Neural Networks as Light as Feather for Face Anti-Spoofing 2019 Peng Zhang
Fuhao Zou
Zhiwen Wu
Nengli Dai
Skarpness Mark
Michael J. Fu
Juan Zhao
Kai Li
+ Robust face anti-spoofing framework with Convolutional Vision Transformer 2023 Yunseung Lee
Youngjun Kwak
Jin‐Ho Shin
+ PDF Chat Meta-Teacher For Face Anti-Spoofing 2021 Yunxiao Qin
Zitong Yu
Longbin Yan
Zezheng Wang
Chenxu Zhao
Zhen Lei
+ Meta-Teacher For Face Anti-Spoofing 2021 Yunxiao Qin
Zitong Yu
Longbin Yan
Zezheng Wang
Chenxu Zhao
Zhen Lei
+ PDF Chat Robust Face Anti-Spoofing Framework with Convolutional Vision Transformer 2023 Yunseung Lee
Youngjun Kwak
Jin‐Ho Shin
+ PDF Chat Multi-Modal Face Anti-Spoofing Based on Central Difference Networks 2020 Zitong Yu
Yunxiao Qin
Xiaobai Li
Zezheng Wang
Chenxu Zhao
Zhen Lei
Guoying Zhao
+ AdvFAS: A robust face anti-spoofing framework against adversarial examples 2023 Jiawei Chen
Xiao Yang
Heng Yin
Mingzhi Ma
Bihui Chen
Jianteng Peng
Yandong Guo
Zhaoxia Yin
Hang Su
+ Deep Frequent Spatial Temporal Learning for Face Anti-Spoofing 2020 Ying Huang
Wenwei Zhang
Jinzhuo Wang
+ PDF Chat Flexible-Modal Face Anti-Spoofing: A Benchmark 2023 Zitong Yu
Ajian Liu
Chenxu Zhao
Kevin H. M. Cheng
Xu Cheng
Guoying Zhao
+ Flexible-Modal Face Anti-Spoofing: A Benchmark 2022 Zitong Yu
Chenxu Zhao
Kevin H. M. Cheng
Xu Cheng
Guoying Zhao

Cited by (27)

Action Title Year Authors
+ PDF Chat Facial Depth and Normal Estimation Using Single Dual-Pixel Camera 2022 Minjun Kang
Jaesung Choe
Hyowon Ha
Hae‐Gon Jeon
Sunghoon Im
In So Kweon
Kuk‐Jin Yoon
+ AdvFAS: A robust face anti-spoofing framework against adversarial examples 2023 Jiawei Chen
Xiao Yang
Heng Yin
Mingzhi Ma
Bihui Chen
Jianteng Peng
Yandong Guo
Zhaoxia Yin
Hang Su
+ PDF Chat Exposing Fine-Grained Adversarial Vulnerability of Face Anti-Spoofing Models 2023 Songlin Yang
Wei Wang
Chenye Xu
Ziwen He
Bo Peng
Jing Dong
+ PDF Chat Domain Generalization via Shuffled Style Assembly for Face Anti-Spoofing 2022 Zhuo Wang
Zezheng Wang
Zitong Yu
Weihong Deng
Jiahong Li
Tingting Gao
Zhongyuan Wang
+ PDF Chat PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer 2022 Zitong Yu
Yuming Shen
Jingang Shi
Hengshuang Zhao
Philip H. S. Torr
Guoying Zhao
+ PDF Chat Learning Meta Pattern for Face Anti-Spoofing 2022 Rizhao Cai
Zhi Li
Renjie Wan
Haoliang Li
Yongjian Hu
Alex C. Kot
+ PDF Chat Flexible-Modal Face Anti-Spoofing: A Benchmark 2023 Zitong Yu
Ajian Liu
Chenxu Zhao
Kevin H. M. Cheng
Xu Cheng
Guoying Zhao
+ PDF Chat Consistency Regularization for Deep Face Anti-Spoofing 2023 Zezheng Wang
Zitong Yu
Xun Wang
Yunxiao Qin
Jiahong Li
Chenxu Zhao
Xin Liu
Zhen Lei
+ PDF Chat 3D High-Fidelity Mask Face Presentation Attack Detection Challenge 2021 Ajian Liu
Chenxu Zhao
Zitong Yu
Anyang Su
Xing Liu
Zijian Kong
Jun Wan
SĂ©rgio Escalera
Hugo Jair Escalante
Zhen Lei
+ PDF Chat La-SoftMoE CLIP for Unified Physical-Digital Face Attack Detection 2024 Hang Zou
Chenxi Du
Hui Zhang
Yuan Zhang
Ajian Liu
Jun Wan
Zhen Lei
+ PDF Chat S-Adapter: Generalizing Vision Transformer for Face Anti-Spoofing with Statistical Tokens 2024 Rizhao Cai
Zitong Yu
Chenqi Kong
Haoliang Li
Changsheng Chen
Yongjian Hu
Alex C. Kot
+ PDF Chat Wild Face Anti-Spoofing Challenge 2023: Benchmark and Results 2023 Dong Wang
Jia Guo
Qiqi Shao
Haochi He
Zhian Chen
Chuanbao Xiao
Ajian Liu
SĂ©rgio Escalera
Hugo Jair Escalante
Zhen Lei
+ PDF Chat AdvFAS: A robust face anti-spoofing framework against adversarial examples 2023 Jiawei Chen
Xiao Yang
Heng Yin
Mingzhi Ma
Bihui Chen
Jianteng Peng
Yandong Guo
Zhaoxia Yin
Hang Su
+ PDF Chat Sound-Print: Generalised Face Presentation Attack Detection using Deep Representation of Sound Echoes 2023 Raghavendra Ramachandra
Jag Mohan Singh
Sushma Venkatesh
+ PDF Chat AdvGen: Physical Adversarial Attack on Face Presentation Attack Detection Systems 2023 Sai Amrit Patnaik
Shivali Chansoriya
Anoop Namboodiri
Anil K. Jain
+ PDF Chat FedSIS: Federated Split Learning with Intermediate Representation Sampling for Privacy-preserving Generalized Face Presentation Attack Detection 2023 Naif Alkhunaizi
Koushik Srivatsan
Faris Almalik
Ibrahim Almakky
Karthik Nandakumar
+ Adaptive-Avg-Pooling Based Attention Vision Transformer for Face Anti-Spoofing 2024 Jichen Yang
Fangfan Chen
Rohan Kumar Das
Zhengyu Zhu
Shunsi Zhang
+ PDF Chat Flickr-PAD: New Face High-Resolution Presentation Attack Detection Database 2023 Diego Pasmiño
Carlos Aravena
Juan Tapia
Christoph Busch
+ PDF Chat FLIP: Cross-domain Face Anti-spoofing with Language Guidance 2023 Koushik Srivatsan
Muzammal Naseer
Karthik Nandakumar
+ PDF Chat Mask Attack Detection Using Vascular-Weighted Motion-Robust rPPG Signals 2023 Chenglin Yao
Jianfeng Ren
Ruibin Bai
Heshan Du
Jiang Liu
Xudong Jiang
+ PDF Chat Rehearsal-Free Domain Continual Face Anti-Spoofing: Generalize More and Forget Less 2023 Rizhao Cai
Yawen Cui
Zhi Li
Zitong Yu
Haoliang Li
Yongjian Hu
Alex C. Kot
+ PDF Chat Benchmarking Joint Face Spoofing and Forgery Detection With Visual and Physiological Cues 2024 Zitong Yu
Rizhao Cai
Zhi Li
Wenhan Yang
Jingang Shi
Alex C. Kot
+ PDF Chat Robust Face Anti-Spoofing Framework with Convolutional Vision Transformer 2023 Yunseung Lee
Youngjun Kwak
Jin‐Ho Shin
+ PDF Chat Dual-Path TokenLearner for Remote Photoplethysmography-Based Physiological Measurement With Facial Videos 2024 Wei Qian
Dan Guo
Kun Li
Xiaowei Zhang
Xilan Tian
Xun Yang
Meng Wang
+ PDF Chat Thin-Plate Spline Motion Model for Image Animation 2022 Jian Zhao
Hui Zhang
+ PDF Chat Vitranspad: Video Transformer Using Convolution And Self-Attention For Face Presentation Attack Detection 2022 Zuheng Ming
Zitong Yu
Musab Ghadi
Muriel Visani
Muhammad Muzzamil Luqman
Jean-Christophe Burie
+ PDF Chat Vulnerability of Face Morphing Attacks: A Case Study on Lookalike and Identical Twins 2023 Raghavendra Ramachandra
Sushma Venkatesh
Gaurav Jaswal
Guoqiang Li

Citing (80)

Action Title Year Authors
+ Learn Convolutional Neural Network for Face Anti-Spoofing 2014 Jianwei Yang
Zhen Lei
Stan Z. Li
+ PDF Chat Fully convolutional networks for semantic segmentation 2015 Jonathan Long
Evan Shelhamer
Trevor Darrell
+ PDF Chat A high performance fingerprint liveness detection method based on quality related features 2010 Javier Galbally
Fernando Alonso‐Fernandez
Juliån Fiérrez
Javier Ortega-GarcĂ­a
+ PDF Chat Face anti-spoofing based on color texture analysis 2015 Zinelabidine Boulkenafet
Jukka Komulainen
Abdenour Hadid
+ PDF Chat Deep Residual Learning for Image Recognition 2016 Kaiming He
Xiangyu Zhang
Shaoqing Ren
Jian Sun
+ In Defense of the Triplet Loss for Person Re-Identification 2017 Alexander Hermans
Lucas Beyer
Bastian Leibe
+ PDF Chat Face De-spoofing: Anti-spoofing via Noise Modeling 2018 Amin Jourabloo
Yaojie Liu
Xiaoming Liu
+ PDF Chat Discriminative representation combinations for accurate face spoofing detection 2018 Xiao Song
Xu Zhao
Liangji Fang
Tianwei Lin
+ PDF Chat FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals 2020 Umur Aybars Çiftçi
Ä°lke Demir
Lijun Yin
+ Aurora Guard: Real-Time Face Anti-Spoofing via Light Reflection 2019 Yao Liu
Ying Tai
Jilin Li
Shouhong Ding
Shuo Wang
Feiyue Huang
Dongyang Li
Wenshuai Qi
Rongrong Ji
+ PDF Chat Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization 2017 Ramprasaath R. Selvaraju
Michael Cogswell
Abhishek Das
Ramakrishna Vedantam
Devi Parikh
Dhruv Batra
+ PDF Chat MobileNetV2: Inverted Residuals and Linear Bottlenecks 2018 Mark Sandler
Andrew Howard
Menglong Zhu
Andrey Zhmoginov
Liang-Chieh Chen
+ PDF Chat Densely Connected Convolutional Networks 2017 Gao Huang
Zhuang Liu
Laurens van der Maaten
Kilian Q. Weinberger
+ PDF Chat Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision 2018 Yaojie Liu
Amin Jourabloo
Xiaoming Liu
+ PDF Chat Deep Tree Learning for Zero-Shot Face Anti-Spoofing 2019 Yaojie Liu
Joel Stehouwer
Amin Jourabloo
Xiaoming Liu
+ PDF Chat A Dataset and Benchmark for Large-Scale Multi-Modal Face Anti-Spoofing 2019 Shifeng Zhang
Xiaobo Wang
Ajian Liu
Chenxu Zhao
Jun Wan
SĂ©rgio Escalera
Hailin Shi
Zezheng Wang
Stan Z. Li
+ PDF Chat FeatherNets: Convolutional Neural Networks as Light as Feather for Face Anti-Spoofing 2019 Peng Zhang
Fuhao Zou
Zhiwen Wu
Nengli Dai
Skarpness Mark
Michael J. Fu
Juan Zhao
Kai Li
+ PDF Chat AdvHat: Real-World Adversarial Attack on ArcFace Face ID System 2021 Stepan Komkov
Aleksandr Petiushko
+ PDF Chat Deep Anomaly Detection for Generalized Face Anti-Spoofing 2019 Daniel PĂ©rez‐Cabo
David JimĂ©nez‐Cabello
Artur Costa‐Pazo
Roberto J. LĂłpez-Sastre
+ Attacking CNN-based anti-spoofing face authentication in the physical domain 2019 Bowen Zhang
Benedetta Tondi
Mauro Barni
+ Learning deep forest with multi-scale Local Binary Pattern features for face anti-spoofing 2019 Rizhao Cai
Changsheng Chen
+ PDF Chat Face Liveness Detection Based on Client Identity Using Siamese Network 2019 Huiling Hao
Mingtao Pei
Meng Zhao
+ PDF Chat Remote Heart Rate Measurement From Highly Compressed Facial Videos: An End-to-End Deep Learning Solution With Video Enhancement 2019 Zitong Yu
Wei Peng
Xiaobai Li
Xiaopeng Hong
Guoying Zhao
+ PDF Chat Regularized Fine-Grained Meta Face Anti-Spoofing 2020 Rui Shao
Xiangyuan Lan
Pong C. Yuen
+ PDF Chat Learning Meta Model for Zero- and Few-Shot Face Anti-Spoofing 2020 Yunxiao Qin
Chenxu Zhao
Xiangyu Zhu
Zezheng Wang
Zitong Yu
Tianyu Fu
Feng Zhou
Jingping Shi
Zhen Lei
+ PDF Chat 3D face mask presentation attack detection based on intrinsic image analysis 2020 Lei Li
Zhaoqiang Xia
Xiaoyue Jiang
Yupeng Ma
Fabio Roli
Xiaoyi Feng
+ PDF Chat Deep Pixel-wise Binary Supervision for Face Presentation Attack Detection 2019 Anjith George
SĂ©bastien Marcel
+ PDF Chat CASIA-SURF: A Large-Scale Multi-Modal Benchmark for Face Anti-Spoofing 2020 Shifeng Zhang
Ajian Liu
Jun Wan
Yanyan Liang
Guodong Guo
SĂ©rgio Escalera
Hugo Jair Escalante
Stan Z. Li
+ PDF Chat Domain Adaptation in Multi-Channel Autoencoder based Features for Robust Face Anti-Spoofing 2019 OÄŒegs ƅikiĆĄins
Anjith George
SĂ©bastien Marcel
+ PDF Chat The Swax Benchmark: Attacking Biometric Systems with Wax Figures 2020 Rafael Henrique Vareto
Araceli Marcia Saldanha
William Robson Schwartz
+ PDF Chat Deep convolutional neural networks for face and iris presentation attack detection: survey and case study 2020 Yomna Safaa El‐Din
Mohamed Moustafa
Hani Mahdi
+ Learning Generalized Spoof Cues for Face Anti-spoofing 2020 Haocheng Feng
Zhibin Hong
Haixiao Yue
Yang Chen
Keyao Wang
Junyu Han
Jingtuo Liu
Errui Ding
+ PDF Chat Deep Spatial Gradient and Temporal Depth Learning for Face Anti-Spoofing 2020 Zezheng Wang
Zitong Yu
Chenxu Zhao
Xiangyu Zhu
Yunxiao Qin
Qiusheng Zhou
Feng Zhou
Zhen Lei
+ PDF Chat Noise Modeling, Synthesis and Classification for Generic Object Anti-Spoofing 2020 Joel Stehouwer
Amin Jourabloo
Yaojie Liu
Xiaoming Liu
+ PDF Chat Learning Meta Face Recognition in Unseen Domains 2020 Jianzhu Guo
Xiangyu Zhu
Chenxu Zhao
Dong Cao
Zhen Lei
Stan Z. Li
+ PDF Chat Single-Side Domain Generalization for Face Anti-Spoofing 2020 Yunpei Jia
Jie Zhang
Shiguang Shan
Xilin Chen
+ PDF Chat Cross-Domain Face Presentation Attack Detection via Multi-Domain Disentangled Representation Learning 2020 Guoqing Wang
Hu Han
Shiguang Shan
Xilin Chen
+ PDF Chat Searching Central Difference Convolutional Networks for Face Anti-Spoofing 2020 Zitong Yu
Chenxu Zhao
Zezheng Wang
Yunxiao Qin
Zhuo Su
Xiaobai Li
Feng Zhou
Guoying Zhao
+ PDF Chat Multi-Modal Face Anti-Spoofing Based on Central Difference Networks 2020 Zitong Yu
Yunxiao Qin
Xiaobai Li
Zezheng Wang
Chenxu Zhao
Zhen Lei
Guoying Zhao
+ PDF Chat Deepfakes and beyond: A Survey of face manipulation and fake detection 2020 Rubén Tolosana
Rubén Vera-Rodríguez
Juliån Fiérrez
Aythami Morales
Javier Ortega-GarcĂ­a