以頭戴式顯示器內建揚聲器建構3D虛擬音場

Abstract

近年來，虛擬實境(VR)技術的進步促進了3D音效技術的發展。然而，頭戴式顯示器必須與耳機搭配使用，而耳機除了配戴不易與衛生問題。為了有效地解決這些問題並且提升用戶體驗，本研究引入了一項將頭戴式顯示器與微型揚聲器結合的新設計，目標為利用此一裝置建構虛擬聽覺空間。為達成此一目標，本研究提出了一個頭戴式顯示器到耳道之間的轉移函數，即虛擬實境相關轉移函數(VR-to-ear-canal transfer function, VRTF)，以建構虛擬聽覺聲場，然後研究了如何利用微型揚聲器播放3D音效。首先，使用有限元素法(FEM)模擬分析頭相關轉移函數(HRTF)的數據庫，並與實驗量測的結果進行比較。接著使用有限元素法模擬分析VRTF，並進行實驗量測，然後與HRTF數據庫結合以實現VR頭戴式顯示器的虛擬聽覺重放技術。最後，使用CAPZ模型估計HRTF與VRTF，以簡化虛擬聽覺重放的訊號處理過程。

The progress in virtual reality (VR) has enabled further application of three-dimensional (3D) audio technology. However, head-mounted displays must be used with headphones, engendering personal hygiene concerns. To solve these problems and enhance user experience, this study introducess a new design for a head-mounted display equipped with microspeakers for creating a virtual auditory space. To achieve signal processing in VR auditory displays, we derived a VR-to-ear-canal transfer function (VRTF) to create virtual auditory spaces and then investigated how to relay 3D audio between human ears and the microspeakers inside the head-mounted display. First, a head-related transfer function (HRTF) database was calculated using the finite element method (FEM) and compared with the function obtained in experiments. Second, VRTFs were calculated using the FEM, measured in experiments, and combined with the HRTF database to achieve signal processing in VR auditory displays. Finally, the CAPZ model of HRTFs and VRTFs was measured to simplify signal processing in VR auditory displays.