‘Gamifying’ Head-Related Transfer Function Training to Improve Localization in Virtual Reality

Authors: Daniel Boachie, Martin Lawless, Brandon Amoafo

SUNY Campus: Maritime College

Presentation Type: Poster

Location: Old Union Hall

Presentation #: 11

Timeslot: Session B 10:15-11:15 AM

Abstract: Virtual Reality (VR) and Augmented Reality (AR) have broadened their use beyond entertainment to fields like education and medicine. Spatial audio, which creates an immersive 3D soundscape, is implemented over headphones by using Head-Related Transfer Functions (HRTFs) to model how sound reaches an individual’s ears by incorporating the sound’s interaction with their head, torso, and pinna. Previous studies have shown that people can improve binaural auditory localization through training with generic HRTFs. However, some participants struggle to make progress due to lack of motivation or unclear instructions. This study aimed to improve the effectiveness of HRTF training by ‘gamifying’ the localization process. Modifications to the training program included adding a tutorial video for clearer instructions and incorporating video game elements like a health bar and countdown timer. The health bar displayed participants' errors and introduced a sense of risk, with participants restarting the scenario if they lost all health. The countdown timer, inspired by NBA shot clocks, created a sense of urgency by changing the color of targets as time ran out. The timer’s difficulty adjusted as participants progressed, giving them less time for more challenging scenarios. A future study will assess the impact of these changes, hypothesizing that they will increase engagement, reduce cognitive load, and improve auditory localization performance.