利用即時視訊建構虛擬鍵盤樂器

Abstract

在科技高度發達的數位時代，科技媒體成為藝術創作的新表現媒介。資訊技術與多媒體的結合帶來了具創新性的數位內容，以及高附加價值的影音互動多媒體產業。本論文介紹並且實作一個互動影音系統；「虛擬鋼琴系統」。研究動機起源於數位虛擬樂器與音樂玩具等相關研究；應用數位影像處理和MIDI技術，結合影音互動即時系統。藉由攝影機對使用者的手部運動作取像偵測，再進行動作的分析，以即時產生相對音高之鋼琴琴聲。本研究主要以虛擬鋼琴彈奏為實作，在技術層面，探討科技和媒體技術，在應用面上可以和數位內容產業之互動式遊戲結合，未來更可延伸至可攜式數位學習載具等產業。

The information technology is highly developed nowadays. It is also used as a new tool for creating the contents. Combining information technology with multimedia can bring us innovative and value-added digital contents for multimedia industries. In this thesis, we will propose and implement an interactive multimedia system, virtual piano system, which integrates information technology with interactive multimedia contents. This research’s motivation is based on a concept originally derived from the digital musical instrument and music toys. In this thesis, we use a video camera to capture the movements of user’s fingertips. After detecting and analyzing the movement, the corresponding piano sound will be played in real-time. Digital image processing and MIDI technology are involved in this study. It has many potential capabilities for developing products for digital content industries such as interactive game and portable digital learning device.