Enabling Secure Voice Input on Augmented Reality Headsets using Internal Body Voice

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Voice-based input is usually used as the primary input method for augmented reality (AR) headsets due to immersive AR experience and good recognition performance. However, recent researches have shown that an attacker can inject inaudible voice commands to the devices that lack voice verification. Even if we secure voice input with voice verification techniques, an attacker can easily steal the victim's voice using low-cast handy recorders and replay it to voice-based applications. To defend against voice-spoofing attacks, AR headsets should be able to determine whether the voice is from the person who is using the AR headsets. Existing voice-spoofing defense systems are designed for smartphone platforms. Due to the special locations of microphones and loudspeakers on AR headsets, existing solutions are hard to be implemented on AR headsets. To address this challenge, in this paper, we propose a voice-spoofing defense system for AR headsets by leveraging both the internal body propagation and the air propagation of human voices. Experimental results show that our system can successfully accept normal users with average accuracy of 97% and defend against two types of attacks with average accuracy of at least 98%.

Original languageEnglish
Title of host publication2019 16th Annual IEEE International Conference on Sensing, Communication, and Networking, SECON 2019
PublisherIEEE Computer Society
ISBN (Electronic)9781728112077
DOIs
StatePublished - Jun 2019
Event16th Annual IEEE International Conference on Sensing, Communication, and Networking, SECON 2019 - Boston, United States
Duration: 10 Jun 201913 Jun 2019

Publication series

NameAnnual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks workshops
Volume2019-June
ISSN (Print)2155-5486
ISSN (Electronic)2155-5494

Conference

Conference16th Annual IEEE International Conference on Sensing, Communication, and Networking, SECON 2019
Country/TerritoryUnited States
CityBoston
Period10/06/1913/06/19

Keywords

  • AR headsets
  • liveness detection
  • voice spoofing attack

Fingerprint

Dive into the research topics of 'Enabling Secure Voice Input on Augmented Reality Headsets using Internal Body Voice'. Together they form a unique fingerprint.

Cite this