Skip to main navigation Skip to search Skip to main content

Landmark Breaker: Obstructing DeepFake by Disturbing Landmark Extraction

  • University of Chinese Academy of Sciences
  • SUNY Buffalo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

26 Scopus citations

Abstract

The recent development of Deep Neural Networks (DNN) has significantly increased the realism of AI-synthesized faces, with the most notable examples being the DeepFakes. The DeepFake technology can synthesize a face of target subject from a face of another subject, while retains the same face attributes. With the rapidly increased social media portals (Facebook, Instagram, etc), these realistic fake faces rapidly spread though the Internet, causing a broad negative impact to the society. In this paper, we describe Landmark Breaker, the first dedicated method to disrupt facial landmark extraction, and apply it to the obstruction of the generation of DeepFake videos. Our motivation is that disrupting the facial landmark extraction can affect the alignment of input face so as to degrade the DeepFake quality. Our method is achieved using adversarial perturbations. Compared to the detection methods that only work after DeepFake generation, Landmark Breaker goes one step ahead to prevent DeepFake generation. The experiments are conducted on three state-of-the-art facial landmark extractors using the recent Celeb-DF dataset.

Original languageEnglish
Title of host publication2020 IEEE International Workshop on Information Forensics and Security, WIFS 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728199306
DOIs
StatePublished - Dec 6 2020
Event2020 IEEE International Workshop on Information Forensics and Security, WIFS 2020 - New York, United States
Duration: Dec 6 2020Dec 11 2020

Publication series

Name2020 IEEE International Workshop on Information Forensics and Security, WIFS 2020

Conference

Conference2020 IEEE International Workshop on Information Forensics and Security, WIFS 2020
Country/TerritoryUnited States
CityNew York
Period12/6/2012/11/20

Fingerprint

Dive into the research topics of 'Landmark Breaker: Obstructing DeepFake by Disturbing Landmark Extraction'. Together they form a unique fingerprint.

Cite this