利用運動視差和遮蔽加強深度知覺及其在互動顯示之應用

Abstract

不論是公共場所或私人環境中，我們都可以發現許多互動顯示裝置. 這些互動顯示通常會使用到LED、LCD、電漿顯示器或投影螢幕來呈現互動效果的視覺回饋。某些情況下，缺乏深度線索會使這些互動顯示的深度感變得很微弱，在部分需要較強烈的深度知覺之互動顯示應用中，缺乏深度感會降低觀眾在互動時的沉浸感。 在這篇研究中，我們計劃使用運動視差與遮蔽加強互動顯示的深度感。我們在Unity3D中建置一個三維場景並產生一個虛擬相機，使用Kinect2追蹤觀眾的頭部位置，根據觀眾的頭部位置資訊改變虛擬像機的位置，模擬出當觀眾移動時，視野範圍變化後應該看見的場景。 應用方面，我們將介紹兩種互動顯示，其一是互動牆: 微笑佛，其二則是互動窗，並說明我們需要加強這兩種互動顯示應用之深度感的原由和實作方法。此外，我們進行了一些實驗，評估加上運動視差配合遮蔽線索後的互動顯示之深度感是否有加強。在我們的實驗結果中可以看到，運動視差配合遮蔽不僅可以加強觀眾對互動顯示的深度感知，還能夠加強觀眾對於視覺內容的注意力以及激起觀眾的互動動機、提升互動顯示之趣味程度。

We can find many interactive displays in both public and private environments. Most of these interactive displays utilize technologies such as liquid-crystal display (LCD), plasma displays or projected images. Sometimes, the depth perception of these displays is weak hence some depth cues are missing. The lake of depth perception may decrease observer’s immersion especially in some applications which require the strong depth experience. In present work, we proposed to improve depth perception of interactive display with motion parallax and occlusion. To create motion parallax effect, we tracked observer’s head position by using kinect2. Construct a 3d scene in unity3D, adapt the position of virtual camera to the head position of observer to create a head coupled or head perspective displays. In applications, we introduce two interactive displays, interactive window and interactive wall-Smiling Buddha and the reason why we enhance the depth perception of these two displays. Besides, we conduct some experiments to evaluate whether motion parallax effect actually enhance the depth perception of these two applications. The results in present work showed that motion parallax not only enhance depth perception of interactive display, but also attract observer’s more attention to the visual contents and invoke their interactive motivation.