Papers for

conference room technology teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Geometry aware system improves multi microphone speaker extraction

Microphone Geometry Aware Regional Target Speaker Extraction

Abstract: Regional target speaker extraction (RSE) aims to extract speech originating from a specified angular region, relaxing the requirement for precise target speaker location when performing location based speech extraction. However, existing RSE methods typically assume a fixed microphone array configuration and microphone number, limiting their applicability to unseen microphone geometries and varying numbers of microphones. In this work, we propose a geometry-aware RSE framework capable of extract with varying microphone array geometry and microphone numbers. Specifically, we introduce an attention-based multichannel front-end to encode inter-microphone phase information, together with a spatial audio reconstruction-based auxiliary objective to improve the front-end spatial representations quality. Experimental results demonstrate that the proposed framework improves SI-SDRi by 5.1 dB over geometry-aware baselines across microphone arrays with four-microphones, while maintaining a performance gap of less than 0.6 dB compared with a tetrahedral geometry-specific baseline when evaluated on the tetrahedral microphone array.

Sat 31 OctSoundArtificial Intelligence
The gist
Extracting a person's voice from audio recorded by multiple microphones usually needs exact speaker location, but this new approach only needs to know roughly where they are. The authors designed a system that adapts to different shapes and numbers of microphones, so it works even if the setup changes. Their method uses a special attention model to understand how sound arrives at each microphone and improves this understanding using spatial reconstruction. Tests show it performs better than previous similar methods and nearly as well as those tuned for a fixed microphone layout.
Open → 2611.00894v1