HoloBand is a clinical tool for audiovisual music perception training in augmented reality (AR) using the Hololens 2 for the hard-of-hearing (HoH).

It consists of two interfaces: a spatial environment in AR for the HoH user and a computer interface to control the training for speech and language pathologists (SLP).

We adopt a participatory exploratory research approach to investigate novel ways of conducting timbre discrimination, audio localization, and pitch recognition. HoloBand is evaluated using a focus group with SLPs (n=6) and interpreted through inductive thematic analysis.

Hololens 2 shows relevant contextual, visual capabilities to enhance music perception training. However, a closer integration into the clinical workflow and a task-oriented approach is necessary to bring real-life scenarios to the clinical setting.

Paper published at AES 2022 International Audio for Virtual and Augmented Reality Conference

It is available at the website.

Ivanyi, B., Tsalidis, C., Naylor, S., Tjemsland, T., Adjorlu, A., Kepp, N. E., & Serafin, S. (2022, August). HoloBand: An Augmented Reality Experience to Train Music Perception for the Hard of Hearing. In Audio Engineering Society Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference. Audio Engineering Society.