任意門：運用行動裝置與空間互動之技術

Abstract

在本篇論文中，我們提出一種運用行動裝置與空間互動之技術，透過本技術，使用者將能直覺地利用行動裝置與空間進行互動。與空間互動的方式有很多種，最常見的就是直接操控空間中的物體(如:電器)、從空間中獲取資訊或是經由互動的過程對於空間有更進一步的認識等等。由於要實現直覺性的操作，本技術必須支援第一人稱的空間瀏覽方式，因此我們整合行動裝置相機與感測器所獲取的影像光流特徵及方向和轉動資訊，用以偵測並追蹤使用者的自身動作與視角改變。此外，為了讓使用者有身歷其境的感受，我們提出兩種於行動裝置螢幕上呈現空間內容的方式，一種為2D呈現方式，另一種為3D呈現方式。在2D呈現方式中，我們利用720度的球型環場影像建立虛擬空間，而在3D呈現方式中，我們則利用該空間的3D模型建立虛擬空間。基於上述的追蹤與呈現方法，我們便能在虛擬空間中保有真實世界的空間感，並且能以使用者的自身動作去操作在虛擬空間中的瀏覽。接著，我們進一步將此技術使用在兩種應用，分別為「陌生空間」及「熟悉空間」之應用。在「陌生空間」應用中，我們實作了「神遊敦煌」，「神遊敦煌」為一遠端導覽系統，此系統利用高解析度平板裝置，將使用者帶進虛擬的敦煌石窟，並結合體感互動，令其產生身歷其境的感受。而在「熟悉空間」應用中，我們實作了「行動中控室」及「智慧家庭控制介面」，此兩種應用皆為快速、直覺而且便於攜帶的控制介面。透過「行動中控室」，既便保全人員不在中控室，仍可利用對於中控室的空間記憶與空間感，以直覺的方式進行監控工作。而透過「智慧家庭控制介面」，儘管使用者不在家中，仍可直覺地操控家中的電器，就如同在家的時候一樣。最後，我們將所提出的介面與其他傳統的介面相比，並且以沉浸度、直覺性、完成時間及錯誤率作為評比的標準，實驗結果顯示，我們的方法比其他介面有更佳的表現。

In this thesis, we present TelePort, a technique based on users’ spatial perception to intuitively interact with spaces using mobile devices. The versatile interaction can include directly controlling or manipulating objects in one space, acquiring some information from one space, touring in one space and so on. In order to provide intuitive interfaces, we support first person navigation during the interaction with space. Therefore, we combine the optical cue and the orientation cue extracted from a build-in camera and sensors in mobile device respectively to estimate the user’s motion and viewpoint. To immerse the user seamlessly into the virtual space, we provide two visualization methods to display the virtual space on the screen of the mobile device: one is the 2D visualization method which we build a 720 degrees three-dimensional spherical panorama to reconstruct the space scene, and the other is the 3D visualization method which we establish a 3D space model for spatial representation. Based on the proposed estimation and visualization methods, the spatial perception in the real world would be preserved in the virtual space and the virtual space navigation can simulate the corresponding motion as the user’s body gestures. Moreover, we applied the technique in two different categories of applications – applications to unfamiliar space and applications to familiar space. In the applications to unfamiliar space, we demonstrate “Dream of Dunhuang”, a remote guide system which allows visitors feeling like being in the Dunhuang cave only by one tablet. In the applications to familiar space, we demonstrate “Mobile Central Control Room for Surveillance” and “Smart Home Control Interface”, which are fast,intuitive and portable interfaces that make users can revisit the central control rooms or their houses anywhere and interact with the objects in the places based on their spatial memory. Finally, we compare our method with other traditional interfaces for environment interaction and evaluate our interface in terms of the level of immersion and presence, completion time and error rate. The experimental results show our interface outperforms the other methods.