請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/29159完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 鄭士康(Shyh-Kang Jeng) | |
| dc.contributor.author | Han-Chen Tsai | en |
| dc.contributor.author | 蔡函辰 | zh_TW |
| dc.date.accessioned | 2021-06-13T00:43:40Z | - |
| dc.date.available | 2007-07-26 | |
| dc.date.copyright | 2007-07-26 | |
| dc.date.issued | 2007 | |
| dc.date.submitted | 2007-07-23 | |
| dc.identifier.citation | [1] Hyperinstrument Homepage, http://www.media.mit.edu/hyperins/ (Visited at 06/08/07)
[2] M. Farbood, E. Pasztor, K. Jennings, 'Hyperscore: A Graphical Sketchpad for Novice Composers.' IEEE Computer Graphics and Applications, January-March 2004. [3] G. Levin and Z. Lieberman, 'In-Situ Speech Visualization in Real-Time Interactive Installation and Performance.' The 3rd International Symposium on Non-Photorealistic Animation and Rendering, Annecy, France, 6/2004 [4] Roger B. Dannenberg and Tom Neuendorffer. “Sound Synthesis from Real-Time Video Images.” Proceedings of the 2003 International Computer Music Conference. San Francisco: International Computer Music Association, pp. 385-388, 2003. [5] Z. Zhou, et al., “Multisensory Musical Entertainment System”, IEEE MultiMedia, Vol. 11, No 3, pp 88-101, 2004. [6] B. Grob, C. Herndon, Basic Television and Video Systems, 6th Ed., McGraw-Hill, USA, 1999. [7] http://en.wikipedia.org/wiki/framerate (Visited at 06/08/07) [8]R.C. Gonzalez, R.E. Woods, Digital Image Processing 2nd Ed., Prentice Hall, USA, 2002. [9]K.L. Chung, Digital Image Processing and Computer Vision, Taiwan Dong Hwa Bookstore, Taipei, Taiwan, 2002. (in Chinese) [10]http://en.wikipedia.org/wiki/Hue (Visited at 06/08/07) [11]Y. Wang, B. Yuan, A novel approach for human face detection from color images under complex background, Pattern Recognition, Vol. 34, No.10, pp 1983-1992, 2001. [12] C. Dodge, T. A. Jerse, Computer Music: Synthesis, Composition, and Performance 2nd Ed, Schirmer/Thomson Learning, USA, 1997. [13] C.J. Sun, A theory of music, Chuan-Yin Score Publishing House 14th Ed., Taipei, Taiwan, ROC, 2004. (in Chinese) [14] Pellman, Samuel. An Introduction to the Creation of Electroacoustic Music, Wadsworth, 1994. [15] Linda Holtzschue, Understanding Color: An Introduction for Designers, 3rd Edition, Wiley Press, 2006 [16] Chih-Wen Liang, Design of a Music-Sound-Synthesis Integrated Circuit Chip, National Taiwan University Department of Computer Science and Information Engineering M.S. Thesis, 2003. | |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/29159 | - |
| dc.description.abstract | 在科技高度發達的數位時代，科技媒體成為藝術創作的新表現媒介。資訊技術與多媒體的結合帶來了具創新性的數位內容，以及高附加價值的影音互動多媒體產業。本論文介紹並且實作一個互動影音系統；「虛擬鋼琴系統」。研究動機起源於數位虛擬樂器與音樂玩具等相關研究；應用數位影像處理和MIDI技術，結合影音互動即時系統。藉由攝影機對使用者的手部運動作取像偵測，再進行動作的分析，以即時產生相對音高之鋼琴琴聲。本研究主要以虛擬鋼琴彈奏為實作，在技術層面，探討科技和媒體技術，在應用面上可以和數位內容產業之互動式遊戲結合，未來更可延伸至可攜式數位學習載具等產業。 | zh_TW |
| dc.description.abstract | The information technology is highly developed nowadays. It is also used as a new tool for creating the contents. Combining information technology with multimedia can bring us innovative and value-added digital contents for multimedia industries. In this thesis, we will propose and implement an interactive multimedia system, virtual piano system, which integrates information technology with interactive multimedia contents. This research’s motivation is based on a concept originally derived from the digital musical instrument and music toys. In this thesis, we use a video camera to capture the movements of user’s fingertips. After detecting and analyzing the movement, the corresponding piano sound will be played in real-time. Digital image processing and MIDI technology are involved in this study. It has many potential capabilities for developing products for digital content industries such as interactive game and portable digital learning device. | en |
| dc.description.provenance | Made available in DSpace on 2021-06-13T00:43:40Z (GMT). No. of bitstreams: 1 ntu-96-R94944010-1.pdf: 1138344 bytes, checksum: 2c64ded9daaa5a5a8fee8664b744057e (MD5) Previous issue date: 2007 | en |
| dc.description.tableofcontents | Abstract i
摘要 ii Contents iii List of Figures v List of tables vii Chapter 1 Introduction 1 1.1 Motivation 1 1.2 Literature Survey 2 1.3 Approach 3 1.4 Organization of Thesis 4 Chapter 2 Background 5 2.1 Video and Interactive System 5 2.2 Color Model and Hue 6 2.3 Audio an MIDI 8 Chapter 3 Design of Interactive Virtual Piano System 13 3.1 Introduction 13 3.2 Image detection 14 3.2.1 Computing Hue from RGB 14 3.2.2 Design of Threshold 15 3.2.2.1 Threshold of Skin Hue Value 16 3.2.2.2 Threshold of Hue Variation 18 3.2.2.3 Discussion of these two methods 23 3.3 Audio Feedback 24 3.3.1 Pitch Shifting Based on Wavetable Synthesis 24 3.3.2 MIDI Note Events 29 3.4 Visual Feedback 33 3.4.1 Interactive Animation Design 33 3.4.2 Interactive User Interface 34 Chapter 4 Experiments and Results 36 4.1 Demonstration of Interactive Virtual Piano System 36 4.2 User Evaluation Experiments 40 Chapter 5 Further Discussions 43 5.1 Velocity Detection 43 5.2 Chroma Key Technique 44 Chapter 6 Conclusions 45 References 46 Appendix A: Questionnaires for User Satisfaction Survey 48 | |
| dc.language.iso | en | |
| dc.subject | 即時 | zh_TW |
| dc.subject | 虛擬樂器 | zh_TW |
| dc.subject | 互動 | zh_TW |
| dc.subject | interactive | en |
| dc.subject | virtual instrument | en |
| dc.subject | real-time | en |
| dc.title | 利用即時視訊建構虛擬鍵盤樂器 | zh_TW |
| dc.title | On Building Virtual Piano System from Real-time Videos | en |
| dc.type | Thesis | |
| dc.date.schoolyear | 95-2 | |
| dc.description.degree | 碩士 | |
| dc.contributor.oralexamcommittee | 張智星(Jyh-Shing Jang),蘇文鈺(Wen-Yu Su),王希俊(Hsi-Chun Wang) | |
| dc.subject.keyword | 虛擬樂器,互動,即時, | zh_TW |
| dc.subject.keyword | virtual instrument,interactive,real-time, | en |
| dc.relation.page | 47 | |
| dc.rights.note | 有償授權 | |
| dc.date.accepted | 2007-07-25 | |
| dc.contributor.author-college | 電機資訊學院 | zh_TW |
| dc.contributor.author-dept | 資訊網路與多媒體研究所 | zh_TW |
| 顯示於系所單位： | 資訊網路與多媒體研究所 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| ntu-96-1.pdf 未授權公開取用 | 1.11 MB | Adobe PDF |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。