On the Effectiveness of Vision Transformers for Zero-shot Face Anti-Spoofing

Type: Article

Publication Date: 2021-07-20

Citations: 80

DOI: https://doi.org/10.1109/ijcb52358.2021.9484333

Download PDF

Abstract

The vulnerability of face recognition systems to presentation attacks has limited their application in security-critical scenarios. Automatic methods of detecting such malicious attempts are essential for the safe use of facial recognition technology. Although various methods have been suggested for detecting such attacks, most of them over-fit the training set and fail in generalizing to unseen attacks and environments. In this work, we use transfer learning from the vision transformer model for the zero-shot anti-spoofing task. The effectiveness of the proposed approach is demonstrated through experiments in publicly available datasets. The proposed approach outperforms the state-of-the-art methods in the zero-shot protocols in the HQ-WMCA and SiW-M datasets by a large margin. Besides, the model achieves a significant boost in cross-database performance as well.

Locations

  • arXiv (Cornell University) - View - PDF
  • Infoscience (Ecole Polytechnique FĂ©dĂ©rale de Lausanne) - View - PDF

Similar Works

Action Title Year Authors
+ Robust face anti-spoofing framework with Convolutional Vision Transformer 2023 Yunseung Lee
Youngjun Kwak
Jin‐Ho Shin
+ PDF Chat Robust Face Anti-Spoofing Framework with Convolutional Vision Transformer 2023 Yunseung Lee
Youngjun Kwak
Jin‐Ho Shin
+ PDF Chat Learning Meta Model for Zero- and Few-Shot Face Anti-Spoofing 2020 Yunxiao Qin
Chenxu Zhao
Xiangyu Zhu
Zezheng Wang
Zitong Yu
Tianyu Fu
Feng Zhou
Jingping Shi
Zhen Lei
+ PDF Chat Deep Tree Learning for Zero-Shot Face Anti-Spoofing 2019 Yaojie Liu
Joel Stehouwer
Amin Jourabloo
Xiaoming Liu
+ Deep Tree Learning for Zero-shot Face Anti-Spoofing 2019 Yaojie Liu
Joel Stehouwer
Amin Jourabloo
Xiaoming Liu
+ FLIP: Cross-domain Face Anti-spoofing with Language Guidance 2023 Koushik Srivatsan
Muzammal Naseer
Karthik Nandakumar
+ PDF Chat FLIP: Cross-domain Face Anti-spoofing with Language Guidance 2023 Koushik Srivatsan
Muzammal Naseer
Karthik Nandakumar
+ FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofing 2023 Ajian Liu
Zichang Tan
Zitong Yu
Chenxu Zhao
Jun Wan
Yanyan Liang
Zhen Lei
Du Zhang
Stan Z. Li
Guodong Guo
+ S-Adapter: Generalizing Vision Transformer for Face Anti-Spoofing with Statistical Tokens 2023 Rizhao Cai
Zitong Yu
Chenqi Kong
Haoliang Li
Changsheng Chen
Yongjian Hu
Alex C. Kot
+ PDF Chat MA-ViT: Modality-Agnostic Vision Transformers for Face Anti-Spoofing 2022 Ajian Liu
Yanyan Liang
+ PDF Chat Deep Learning for Face Anti-Spoofing: A Survey 2022 Zitong Yu
Yunxiao Qin
Xiaobai Li
Chenxu Zhao
Zhen Lei
Guoying Zhao
+ Deep Learning for Face Anti-Spoofing: A Survey 2021 Zitong Yu
Yunxiao Qin
Xiaobai Li
Chenxu Zhao
Zhen Lei
Guoying Zhao
+ IFAST: Weakly Supervised Interpretable Face Anti-spoofing from Single-shot Binocular NIR Images 2023 Jiancheng Huang
Donghao Zhou
Shifeng Chen
+ MA-ViT: Modality-Agnostic Vision Transformers for Face Anti-Spoofing 2023 Ajian Liu
Yanyan Liang
+ Two-stream Convolutional Networks for Multi-frame Face Anti-spoofing 2021 Zhuoyi Zhang
Cheng Jiang
Xiya Zhong
Chang Song
Yifeng Zhang
+ PDF Chat FaceCat: Enhancing Face Recognition Security with a Unified Generative Model Framework 2024 Jiawei Chen
Xiao Yang
Yinpeng Dong
Hang Su
Jianteng Peng
Zhaoxia Yin
+ Learning Facial Liveness Representation for Domain Generalized Face Anti-spoofing 2022 Zih-Ching Chen
Lin-Hsi Tsao
Chin-Lun Fu
Shang‐Fu Chen
Yu-Chiang Frank Wang
+ PDF Chat Learning Facial Liveness Representation for Domain Generalized Face Anti-Spoofing 2022 Zih-Ching Chen
Lin-Hsi Tsao
Chin-Lun Fu
Shang‐Fu Chen
Yu-Chiang Frank Wang
+ PDF Chat Multi-Modal Face Anti-Spoofing Based on Central Difference Networks 2020 Zitong Yu
Yunxiao Qin
Xiaobai Li
Zezheng Wang
Chenxu Zhao
Zhen Lei
Guoying Zhao
+ PatchNet: A Simple Face Anti-Spoofing Framework via Fine-Grained Patch Recognition 2022 Chien-Yi Wang
Yu-Ding Lu
Shang-Ta Yang
Shang‐Hong Lai

Works That Cite This (23)

Action Title Year Authors
+ Explaining Face Presentation Attack Detection Using Natural Language. 2021 Hengameh Mirzaalian
Mohamed E. Hussein
Leonidas Spinoulas
Jonathan May
Wael AbdAlmageed
+ PDF Chat Deep Learning for Face Anti-Spoofing: A Survey 2022 Zitong Yu
Yunxiao Qin
Xiaobai Li
Chenxu Zhao
Zhen Lei
Guoying Zhao
+ PDF Chat Flexible-Modal Face Anti-Spoofing: A Benchmark 2023 Zitong Yu
Ajian Liu
Chenxu Zhao
Kevin H. M. Cheng
Xu Cheng
Guoying Zhao
+ PDF Chat Consistency Regularization for Deep Face Anti-Spoofing 2023 Zezheng Wang
Zitong Yu
Xun Wang
Yunxiao Qin
Jiahong Li
Chenxu Zhao
Xin Liu
Zhen Lei
+ PDF Chat FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofing 2023 Ajian Liu
Zichang Tan
Zitong Yu
Chenxu Zhao
Jun Wan
Yanyan Liang
Zhen Lei
Du Zhang
Stan Z. Li
Guodong Guo
+ PDF Chat Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignment 2023 Yiyou Sun
Yaojie Liu
Xiaoming Liu
Yixuan Li
Wen–Sheng Chu
+ Consistency Regularization for Deep Face Anti-Spoofing 2021 Zezheng Wang
Zitong Yu
Xun Wang
Yunxiao Qin
Jiahong Li
Chenxu Zhao
Zhen Lei
Xin Liu
Size Li
Zhongyuan Wang
+ PDF Chat S-Adapter: Generalizing Vision Transformer for Face Anti-Spoofing with Statistical Tokens 2024 Rizhao Cai
Zitong Yu
Chenqi Kong
Haoliang Li
Changsheng Chen
Yongjian Hu
Alex C. Kot
+ PDF Chat Attacking Face Recognition With T-Shirts: Database, Vulnerability Assessment, and Detection 2023 Mathias Ibsen
Christian Rathgeb
Fabian Brechtel
Ruben Klepp
Katrin Pöppelmann
Anjith George
SĂ©bastien Marcel
Christoph Busch
+ Deep Learning for Face Anti-Spoofing: A Survey 2021 Zitong Yu
Yunxiao Qin
Xiaobai Li
Chenxu Zhao
Zhen Lei
Guoying Zhao