基于方向特征提取的头相关传输函数稀疏重构方法
Sparse reconstruction of head-related transfer functions based on directional feature extraction
-
摘要: 提出了一种基于方向特征提取的头相关传输函数(HRTF)稀疏重构方法。该方法针对现有基于深度学习的HRTF稀疏重构方法的输入受限于特定采样方向的问题, 以空间稀疏采样的HRTF结合其方向信息为输入, 通过方向编码器提取HRTF的方向特征, 并分别将其与频谱编码器的频域特征及起始时间编码器的时域特征进行融合, 从而增强模型对不同采样方向下稀疏HRTF与高空间分辨率HRTF之间关联的理解, 提高模型对采样方向变化的适应性。实验结果表明, 所提方法在非特定网格采样HRTF的情况下, 对全空间HRTF的重构性能优于现有方法。在谱失真、双耳时间差等客观评价指标以及听觉定位模型的定位精度和虚拟声源听觉定位测试中, 均表现出了较优的性能。Abstract: A sparse reconstruction method for Head-Related Transfer Functions (HRTFs) based on directional feature extraction is proposed. This method addresses the limitation of existing deep learning-based HRTF sparse reconstruction approaches, which rely on HRTF inputs sampled from specific grids. It takes spatially sparse HRTFs and their directional information as input, extracts directional features through a directional encoder, and separately integrates them with the frequency domain features of the spectral encoder and the temporal features of the onset time encoder. This fusion enhances the model’s understanding of the relationship between sparsely sampled HRTFs from various directions and high-resolution HRTFs, thereby improving its adaptability to variations in input directions. The experimental results indicate that the proposed method outperforms existing methods in reconstructing full-space HRTF under non-specific grid sampling conditions. It also demonstrates superior performance in objective evaluation metrics such as spectral distortion and interaural time differences, as well as in the accuracy of auditory localization models and virtual sound source localization tests.
下载: