Abstract
The Time Difference of Arrival (TDoA) of a sound wavefront impinging on a microphone pair carries spatial information about the source. However, captured speech typically contains dynamic non-speech interference sources and noise. Therefore, the TDoA estimates fluctuate between speech and interference. Deep Neural Networks (DNNs) have been applied for Time-Frequency (TF) masking for Acoustic Source Localization (ASL) to filter out non-speech components from a speaker location likelihood function. However, the type of TF mask for this task is not obvious. Secondly, the DNN should estimate the TDoA values, but existing solutions estimate the TF mask instead. To overcome these issues, a direct formulation of the TF masking as a part of a DNN-based ASL structure is proposed. Furthermore, the proposed network operates in an online manner, i.e., producing estimates frame-by-frame. Combined with the use of recurrent layers it exploits the sequential progression of speaker related TDoAs. Training with different microphone spacings allows model re-use for different microphone pair geometries in inference. Real-data experiments with smartphone recordings of speech in interference demonstrate the network's generalization capability.
Original language | English |
---|---|
Title of host publication | 2019 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2019 - Proceedings |
Publisher | IEEE |
Pages | 436-440 |
Number of pages | 5 |
ISBN (Electronic) | 9781479981311 |
DOIs | |
Publication status | Published - 1 May 2019 |
Publication type | A4 Article in conference proceedings |
Event | IEEE International Conference on Acoustics, Speech, and Signal Processing - Brighton, United Kingdom Duration: 12 May 2019 → 17 May 2019 |
Conference
Conference | IEEE International Conference on Acoustics, Speech, and Signal Processing |
---|---|
Country/Territory | United Kingdom |
City | Brighton |
Period | 12/05/19 → 17/05/19 |
Keywords
- Acoustic Source Localization
- Microphone Arrays
- Recurrent Neural Networks
- Time-Frequency Masking
Publication forum classification
- Publication forum level 1
ASJC Scopus subject areas
- Software
- Signal Processing
- Electrical and Electronic Engineering