Binaural Sound Source Distance Estimation and Localization for a Moving Listener

Research output: Contribution to journalArticleScientificpeer-review

12 Downloads (Pure)

Abstract

In this paper, we investigate the tasks of binaural source distance estimation (SDE) and direction-of-arrival estimation (DOAE) using motion-based cues in a scenario with a walking listener. On top of performing both tasks as separate problems, we study two methods of solving the joint task of simultaneous source distance estimation and localization (SDEL), with a single model. Experiments are conducted for three different scenarios: a static receiver; a static receiver with a rotating head; and a freely moving listener inside a room. The study proposes rotation and translation features to include information about the receiver's motion during model training and studies the effects of these on the final performance. The work includes extended simulation of three datasets containing numerous testing scenarios for sound sources, covering a wide range of DOAs and a source-to-receiver distance up to 15 m. Results are further analyzed with respect to room reverberation, walking speed, as well as source-to-receiver distance. The presented outcomes show large improvements in both DOA and distance estimation for a model that uses motion-based cues as compared with a static scenario. These include a decrease of 9.50° in DOA and 1.56m in distance errors for a joint model, followed by 16.17° and 0.17m for separate models.

Original languageEnglish
Pages (from-to)996 - 1011
Number of pages16
JournalIEEE/ACM Transactions on Audio Speech and Language Processing
Volume32
Early online date22 Dec 2023
DOIs
Publication statusPublished - 2024
Publication typeA1 Journal article-refereed

Keywords

  • Azimuth
  • binaural audio
  • Direction-of-arrival estimation
  • Estimation
  • Location awareness
  • Receivers
  • Recording
  • sound distance estimation
  • sound source localization
  • Task analysis

Publication forum classification

  • Publication forum level 3

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Acoustics and Ultrasonics
  • Computational Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Binaural Sound Source Distance Estimation and Localization for a Moving Listener'. Together they form a unique fingerprint.

Cite this