Skip to main navigation Skip to search Skip to main content

The Competition of Fairness in AI-generated Face Detection: Methods and Results

  • Shu Hu
  • , Li Lin
  • , Shail Desai
  • , Aditya Pawar
  • , Guangyu Lin
  • , Xin Wang
  • , Daniel S. Schiff
  • , Sachi Nandan Mohanty
  • , Ryan Ofman
  • , Narcis Bejtic
  • , Jon Gillham
  • , Wenbin Zhang
  • , Baoyuan Wu
  • , Cristian Canton
  • , Xiaoming Liu
  • , Luisa Verdoliva
  • , Siwei Lyu
  • , Yongwei Tang
  • , Zhiqiang Wu
  • , Jiawen Seow
  • Zara Alaverdyan, Anne Flore Baron, Simon Bozonnet, Martins Bruveris, Jochem Gietema, Lucia Innocenti, Lisa Ivanova, Olivier Koch, Harry Ni, Arthur Pajot, Romain Sabathe, Fengming Gu, Xingming Long, Jie Zhang, Wenqing Ge, Xiangkui Cao, Yuecong Min, Yingjie Liu, Zonghui Guo, Shiguang Shan, Jinhee Park, Minjun Kim, Ahyeon Park, Guisik Kim, Taewoo Kim, Young Joon Yoo, Junseok Kwon, Zhaoda Li, Mengyun Tang, Leyang Huang, Bogdan Dura, Sebastian Balmuş, Fang Yi Su, Tsung Hua Lee, Ting Wan Kao
  • Purdue University
  • SUNY Albany
  • VIT-AP University
  • Deep Media AI Inc.
  • Originality.AI Inc.
  • Michigan Technological University
  • The Chinese University of Hong Kong, Shenzhen
  • Barcelona Supercomputing Center
  • University of North Carolina at Chapel Hill
  • University of Naples Federico II
  • Ant International
  • Entrust Corp.
  • CAS - Institute of Computing Technology
  • Ocean University of China
  • Chung-Ang University
  • Korea Electronics Technology Institute
  • The University of Hong Kong
  • National Institute for Research and Development in Informatics
  • Harvard University

Research output: Contribution to journalComment/debate

Abstract

AI-generated facial synthesis (DeepFakes) has rapidly progressed through advanced generative models, producing realistic manipulated media that is increasingly difficult to distinguish from authentic content. Misuse of these technologies threatens public trust and democratic stability, particularly in sensitive contexts. Beyond detection accuracy, responsible forensic analysis demands fair and ethical deployment, yet recent studies reveal demographic performance disparities that existing methods have not adequately addressed, and fairness approaches often fail to generalize under distribution shifts. To address this issue, we organized the first competition focused on fairness in AI-generated face detection at NeurIPS 2025, connecting fairness research with real-world DeepFake challenges. The competition attracted substantial global participation, including more than 64 registered teams and 158 participants from 63 organizations across 20 countries, with 11 teams surpassing the baseline. Analysis of the submitted methods reveals that the most effective approaches combined data-centric design, robust representation learning, and model-level diversification rather than relying on fairness constraints alone. In particular, the top-ranked solution achieved strong fairness improvements by integrating careful data curation, a mixture-of-experts architecture, and test-time augmentation, demonstrating that fairness generalization can be improved without explicitly optimizing demographic-specific losses. Other competitive methods explored complementary directions, including foundation-model-based feature extraction, dual-branch fusion of global and local cues, ensemble learning, and post hoc calibration, each exposing distinct trade-offs among fairness, utility, and deployability. Our findings highlight that fairness metrics can be significantly improved through strategic system design, but also reveal limitations of current evaluation protocols and the risk of trivial solutions under fixed thresholds. Overall, this competition provides concrete empirical evidence and methodological insights for building more fair, robust, and trustworthy DeepFake detection systems, and offers guidance for future benchmarks, evaluation metrics, and responsible deployment practices. The competition website is available at: https://sites.google.com/view/aifacedetection/.

Original languageEnglish
Pages (from-to)501-527
Number of pages27
JournalMachine Intelligence Research
Volume23
Issue number3
DOIs
StatePublished - Jun 2026

Keywords

  • AI-generated face
  • DeepFake detection
  • competition
  • cybersecurity
  • fairness

Fingerprint

Dive into the research topics of 'The Competition of Fairness in AI-generated Face Detection: Methods and Results'. Together they form a unique fingerprint.

Cite this