遙控條列式選單之手勢辨識系統

Abstract

近年來遠端遙控數位媒體內容已在互動式遊戲及數位家庭應用成為重要課題。在本篇論文中，我們提出一種新的使用者介面，讓使用者在空中用單手做畫圓的動作，就可以控制呈現在遠方之顯示器的條列式選單，近而達到控制數位內容的目的。在此設計中，使用者無須使用任何實體裝置，而是用一些簡單的動作就可以達成所有的工作。根據此原則，我們發展出一套基於視覺方法而偵測使用者手掌位置和其移動軌跡的系統。我們使用場景中物體的深度、移動情形與形狀來判斷使用者手掌的位置，接著再利用粒子濾波器持續追蹤使用者的手掌。接著我們再分析手掌的軌跡來決定是否有一些合法的動作發生，且此系統能夠對於不同的手勢動作即時回應。經過實驗證實，本篇論文所提出的方法能夠在有許多干擾的環境中運作良好。

Recent years remote control of media content has become an important issue in interactive games or digital home application. In this thesis we introduce a new type of user interface which allows user to control the media via a list menu shown on a distant display by simply drawing circles in the air with one hand. Instead of using a physical device such as a hand-held remote control, user simply performs some predefined motion to accomplish all tasks. Based on this design, we develop a vision-based system to detect user's palm and its motion trajectory. Depth, motion and shape are adopted to estimate the location of a palm before a particle filter is used to track the target continuously. Then, we analyze the trajectory of the palm to determine if there is a legal motion occurs. This system can respond to user’s gesture in real-time. Experimental results confirm that it is quite robust to interferences existed in the environment.