多重解析度互動桌面系統之顯卡加速的軟體開發套件

Abstract

隨著科技的發達，將電腦引入日常生活的互動桌面系統已經變得越來越受注目。目前，許多學術研究都致力於如何在互動桌面系統建構大型的高解析度顯示環境，指觸人機互動的技術開發和人性化介面設計等。 基於互動桌系統的需求，我們發展了一個利用背投影技術的多重顯示多指觸控的互動桌面顯示系統，稱為Interactive Multi-Resolution And Multi-Touch Tabletop，簡稱i-m-Top。這個系統主要分成多指指觸偵測與追蹤，手勢辨識，多重影像校正和軟體開發套件，而這個系統最大的賣點就是採用了顯卡來加速影像處理的部分，讓使用者在跟桌面互動的時候，不再覺得畫面不順暢，進而改善使用者對桌面系統的操控。 在多指指觸偵測與追蹤方面，我們主要是利用紅外線照射燈對桌面均勻的打光，再利用紅外線攝影機將桌面背部的影像擷取出來，然後透過影像處理的方式進行手指的偵測及追蹤；當有了手指的資訊之後，我們必須持續追蹤手指的位置，這樣手指辨識才有辦法辨識出目前使用者所使用的操控手勢，好讓訊號傳到軟體開發套件後，再根據手指在畫面上所觸碰的畫面，去做相對應的互動。

The development of technology knowledge has never been stopped ever since human beings were brought to this planet. And lots of technology products nowadays have been used to facilitate humans’ daily life. Currently, even the table we used to dine or work is now combined with technology which we called the interactive display tabletop. The tabletop is designed to use a large display with high-resolution that clearly shows users the display region they’re interested and another large display with low-resolution that presumably shows the region out of the users’ interested region. In addition, a more intuitive way of manipulating the digital contents on the display system is also designed, like finger touching. It is known that when a user interacts with a system, no one would tolerate the lag time of corresponding responses which will piss the users off. And this is mostly caused by the failure design of software architecture in which all the image and signal processing takes place in CPU. In order to enhance the system’s performance, we propose a method that uses GPU processing which utilizes the concept of parallel programming.