Skip to main navigation Skip to search Skip to main content

An Interpretable Transformer-Based Foundation Model for Cross-Procedural Skill Assessment Using Raw fNIRS Signals

  • Rensselaer Polytechnic Institute
  • Florida State University
  • U.S. Army Combat Capabilities Development Command Soldier Center

Research output: Contribution to journalArticlepeer-review

Abstract

Objective skill assessment in high-stakes procedural environments requires models that not only decode underlying cognitive and motor processes but also generalize across tasks, individuals, and experimental contexts. While prior work has demonstrated the potential of functional near-infrared spectroscopy (fNIRS) for evaluating cognitive-motor performance, existing approaches are often task-specific, rely on extensive preprocessing, and lack robustness to new procedures or conditions. Here, we introduce an interpretable transformer-based foundation model trained on minimally processed fNIRS signals for cross-procedural skill assessment. Pretrained using self-supervised learning on data from laparoscopic surgical tasks and endotracheal intubation (ETI), the model achieves >88% classification accuracy on all tasks, with Matthews Correlation Coefficient exceeding 0.91 on ETI. It generalizes to a novel emergency airway procedure—cricothyrotomy—using as few as 24 labeled samples and a lightweight (<3k parameter) adapter module, attaining an AUC greater than 85%. Interpretability is achieved via a novel channel attention mechanism—developed specifically for fNIRS—that identifies functionally coherent prefrontal sub-networks validated through ablation studies. Temporal attention patterns align with task-critical phases and capture stress-induced changes in neural variability, offering insight into dynamic cognitive states.

Original languageEnglish
Article number45
JournalACM Transactions on Computing for Healthcare
Volume7
Issue number3
DOIs
StatePublished - May 18 2026

Keywords

  • Foundation models
  • Neuroimaging
  • Parameter-efficient Fine Tuning
  • Surgical/Medical skill assessment

Fingerprint

Dive into the research topics of 'An Interpretable Transformer-Based Foundation Model for Cross-Procedural Skill Assessment Using Raw fNIRS Signals'. Together they form a unique fingerprint.

Cite this