利用深度攝影機超越桌面顯示系統之互動方式

Abstract

近年來，互動桌面顯示系統一直是相當熱門的研究課題。但一般的互動桌面顯示系統都只侷限在桌面上進行操作，本論文希望提出一個新的互動方式有效地將使用者的互動區域擴展至桌面上方的空間而不受限於桌面平面上，進而增加了直覺式操作的可能性。本系統在一般的桌面顯示系統中額外增加了一個深度攝影機，利用其可以偵測物體深度的特性進而計算出物體在3D空間中的位置，再搭配粒子濾波法的追蹤技術，我們可以隨時取得桌面顯示系統與使用者手上行動裝置的空間關係，以達到不同的應用。藉由此技術，本系統實現了平板電腦與桌面顯示系統在桌面以上的互動方式，成功地展示此互動顯示系統的可行性。

Interactive surfaces in particular have been received much attention in recent years. Lots of researches have emphasized on this area and try to find more possibilities on the general interactive surface. In this work, we propose a new method let users interact not only on but also beyond the tabletop surface. It is intuitive for users and utilizes the space beyond the surface effectively. We additionally add a depth camera which can compute depth information and 3D positions of objects with the tabletop surface in our system. By integrating with particle filtering, we can figure out the spatial relationship between the tabletop surface and the mobile device in user‘s hands. Based on the proposed techniques, we present an interactive application: imView2 which can let users interact with the surface freely through a tablet PC. It enables beyond-surface interaction and allows more intuitive navigations and is fun to use.