RelUNet: Relative Channel Fusion U-Net for Multichannel Speech Enhancement

Neural multi-channel speech enhancement models, specifically U-Net-based ones, show promising performance and generalization potential. These models encode input channels independently, and integrate them during later stages, or rely on extensive feature extraction methods. We propose a novel modification by incorporating relative information from the outset, where each channel is processed in conjunction with a reference channel through stacking. This exploits comparative differences to adaptively fuse information between channels, enhancing the representation of spatial features and improving the overall performance. Theoretical analysis shows that differential encoding leads to more compact manifolds, contributing to better generalization by capturing invariant features. The experiments conducted on the CHiME-3 dataset demonstrate improvements in speech enhancement metrics across various architectures. We show that our method enhances model capabilities in spatial feature processing, demonstrating strong performance in TDOA estimation on simulated datasets.

Citation

I. Aldarmaki, T. Solorio, B. Raj, H. Aldarmaki, "RelUNet: Relative Channel Fusion U-Net for Multichannel Speech Enhancement," 2026, pp. 21031-21035.

Source

ICASSP 2026 - 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Conference

ICASSP 2026 - 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Keywords

46 Information and Computing Sciences, 4603 Computer Vision and Multimedia Computation, 4611 Machine Learning

Source

ICASSP 2026 - 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Publisher

IEEE

DOI

10.1109/icassp55912.2026.11461436

Additional links

https://ieeexplore.ieee.org/document/11461436