Skip to main navigation Skip to search Skip to main content

Multi-Teacher Single-Student Visual Transformer with Multi-Level Attention for Face Spoofing Detection

  • Yao Hui Huang
  • , Jun Wei Hsieh
  • , Ming Ching Chang
  • , Lipeng Ke
  • , Siwei Lyu
  • , Arpita Samanta Santra
  • National Taiwan Ocean University
  • National Yang Ming Chiao Tung University
  • SUNY Albany
  • SUNY Buffalo

Research output: Contribution to conferencePaperpeer-review

13 Scopus citations

Abstract

Face biometrics have attracted significant attention in many security-based applications. The presentation attack (PA) or face spoofing is a cybercriminal attempt to gain illegitimate access to a victim's device using photos, videos, or 3D artificial masks of the victim's face. Various deep learning approaches can tackle particular PA attacks when tested on standard datasets. However, these methods fail to generalize to complex environments or unseen datasets. We propose a new Multi-Teacher Single-Student (MTSS) visual Transformer with a multi-level attention design to improve the generalizability of face spoofing detection. Then, a novel Multi-Level Attention Module with a DropBlock (MAMD) is designed to strengthen discriminative features while dropping irrelevant spatial features to avoid overfitting. Finally, these rich convolutional feature sets are combined and fed into the MTSS network for face spoofing training. With this MAMD module, our method survives well under small training datasets with poorly lighted conditions. Experimental results demonstrate the superiority of our method when compared with several anti-spoofing methods on four datasets (CASIA-MFSD, Replay-Attack, MSU-MFSD, and OULU-NPU). Furthermore, our model can run on Jetson TX2 up to 80 FPS for real-world applications.

Original languageEnglish
StatePublished - 2021
Event32nd British Machine Vision Conference, BMVC 2021 - Virtual, Online
Duration: Nov 22 2021Nov 25 2021

Conference

Conference32nd British Machine Vision Conference, BMVC 2021
CityVirtual, Online
Period11/22/2111/25/21

Fingerprint

Dive into the research topics of 'Multi-Teacher Single-Student Visual Transformer with Multi-Level Attention for Face Spoofing Detection'. Together they form a unique fingerprint.

Cite this