Skip to main navigation Skip to search Skip to main content

Wavesdropper: Through-wall word detection of human speech via commercial mmwave devices

  • Chao Wang
  • , Feng Lin
  • , Zhongjie Ba
  • , Fan Zhang
  • , Wenyao Xu
  • , Kui Ren
  • Zhejiang University

Research output: Contribution to journalArticlepeer-review

43 Scopus citations

Abstract

Most existing eavesdropping attacks leverage propagating sound waves for speech retrieval. However, soundproof materials are widely deployed in speech-sensitive scenes (e.g., a meeting room). In this paper, we reveal that human speech protected by an isolated room can be compromised by portable and commercial off-The-shelf mmWave devices. To achieve this goal, we develop Wavesdropper, a word detection system that utilizes a mmWave probe to sense the targeted speaker's throat vibration and recover speech contents in the obstructed condition. We proposed a CEEMD-based method to suppress dynamic clutters (e.g., human movements) in the room and a wavelet-based processing method to extract the delicate vocal vibration information from the hybrid signals. To recover speech contents from mmWave signals related to the vocal vibration, we designed a neural network to infer the speech contents. Moreover, we explored word detection on a conversation with multiple (two) probes and reveal that the adversary can detect words on multiple people simultaneously with only one mmWave device. We performed extensive experiments to evaluate the system performance with over 60,000 pronunciations. The experimental results indicate that Wavesdropper can achieve 91.3% accuracy for 57-word recognition on 23 volunteers.

Original languageEnglish
Article number77
JournalProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Volume6
Issue number2
DOIs
StatePublished - Jul 2022

Keywords

  • mmWave sensing
  • through walls
  • word detection

Fingerprint

Dive into the research topics of 'Wavesdropper: Through-wall word detection of human speech via commercial mmwave devices'. Together they form a unique fingerprint.

Cite this