請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/67155
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 丁肇隆 | |
dc.contributor.author | Yen-Hsiang Chen | en |
dc.contributor.author | 陳延祥 | zh_TW |
dc.date.accessioned | 2021-06-17T01:21:40Z | - |
dc.date.available | 2017-08-14 | |
dc.date.copyright | 2017-08-14 | |
dc.date.issued | 2017 | |
dc.date.submitted | 2017-08-10 | |
dc.identifier.citation | [1] Potcharapol Suteparuk, “Detection of Piano Keys Pressed in Video”, 2014
[2] Gorodnichy, Dmitry O. and Arjun Yogeswaran. “Detection and tracking of pianist hands and fingers.” The 3rd Canadian Conference on Computer and Robot Vision (CRV'06) (2006): 63-63. [3] Hashimoto, M., & Oka, A. (2013). Marker-less piano fingering recognition using sequential depth images. The 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision, 1-4. [4] Eddins, S.L., González, R.C., & Woods, R.E. (2004). Digital image processing using MATLAB. [5] Haralick, R. M., and L. G. Shapiro, Computer and Robot Vision, Vol. I, Addison-Wesley (1992): 158-205. [6] Boomgaard, Rein van den and Richard van Balen. “Methods for fast morphological image transforms using bitmapped binary images.” CVGIP: Graphical Model and Image Processing 54 (1992): 252-258. [7] Toiviainen, P., & Eerola, T. (2016). MIDI Toolbox 1.1., https://github.com/miditoolbox/1.1 [8] PiannoKeyz., https://www.youtube.com/watch?v=q3YKrf7F3IU [9] Mido., http://mido.readthedocs.io/en/latest/midi_files.html [10] Ron Brinkmann, “The Art and Science of Digital Compositing.” Morgan Kaufmann (1999): 184. [11] Charles A. Poynton, “Digital Video and HDTV: Algorithms and Interfaces.” Morgan Kaufmann (2003) [12] Nicholas Boughen, “Lightwave 3d 7.5 Lighting.” Wordware Publishing (2003) [13] Stephen Johnson, “Stephen Johnson on Digital Photography.” O'Reilly (2006). [14] Image Analyst, https://www.mathworks.com/matlabcentral/fileexchange/28512-simplecolordetectionbyhue-- [15] Ron Brinkmann, “The Art and Science of Digital Compositing.” Morgan Kaufmann. (1999): 184. [16] OTSU, N. (2008). Tlreshold Selection Method from Gray-Level Histograms. [17] A. Rosenfeld , A. C. Kak (1982), Digital Picture Processing, Academic Press, Inc. [18] Cheng, CC; Peng, GJ; Hwang, WL (2009), 'Mathworks: Pixel Connectivity', IEEE transactions on image processing : a publication of the IEEE Signal Processing Society, 18 (1): 52–62 [19] Cheng, CC; Peng, GJ; Hwang, WL (2009), 'Pixel Connectivity', IEEE transactions on image processing : a publication of the IEEE Signal Processing Society, 18 (1): 52–62 [20] Jean Serra, “Image Analysis and Mathematical Morphology.” (1982) [21] Jean Serra, “Image Analysis and Mathematical Morphology, Volume 2: Theoretical Advances.” (1988) [22] Edward R. Dougherty, “An Introduction to Morphological Image Processing” (1992) [23] Soille, P., Morphological Image Analysis: Principles and Applications, Springer-Verlag, 1999, pp. 173-174. [24] Addison-Wesley, “Design Patterns: Elements of Reusable Object-Oriented Software.” (1995) [25] Anderson R., “The Credit Scoring Toolkit. Oxford University Press.” (2007) [26] Refaat M., “Data Preparation for Data Mining Using SAS.” Morgan Kaufmann (2006) [27] Refaat M., “Credit Risk Scorecards: Development and Implementation Using SAS.” lulu.com, 2011. [28] Lyn C. Thomas, David B. Edelman, and Jonathan N. Crook, “Credit Scoring and Its Applications.” Society for Industrial and Applied Mathematics (2002) [29] Nishio, S., Takegawa, Y., & Terada, T. (2006). Design and Implementation of a Real-Time Fingering Detection System for Piano Performance. ICMC. [30] WIDI, by Widisoft, MP3 to MIDI and WAVE to MIDI Converter. https://www.widisoft.com/ [31] Digital Ear, Convert Audio (.wav) files to MIDI. http://www.digital-ear.com/digital-ear/index.asp [32] Furuya, Shinichi et al. “Hand kinematics of piano playing.” Journal of neurophysiology 106 6 (2011): 2849-64. [33] Letessier, Julien and François Bérard. “Visual tracking of bare fingers for interactive surfaces.” UIST (2004). [34] Mackie, J., & McCane, B., “Finger Detection with Decision Trees.” (2004) [35] Adams, R., 'Radial Decomposition of Discs and Spheres,' Computer Vision, Graphics, and Image Processing: Graphical Models and Image Processing, Vol. 55, Number 5, pp. 325–332, September 1993. [36] Jones, R., and P. Soille, 'Periodic lines: Definition, cascades, and application to granulometrie,' Pattern Recognition Letters, Vol. 17, pp. 1057–1063, 1996. [37] Powers, David M W (2011). 'Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation' (PDF). Journal of Machine Learning Technologies. 2 (1): 37–63 | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/67155 | - |
dc.description.abstract | 本研究旨在建立一種新的琴譜紀錄方式。以鋼琴為實驗平台,配合當代電腦影像處理的技術,將傳統撰寫鋼琴琴譜的方式從硬體移植到軟體上。本研究的目的是在於提供打譜軟體使用者及音樂教育者能以更低成本,使用規範上更簡易的方式進行樂理中音調及拍數的紀錄。由於錄影設備及電腦使用的普及,當代的樂器演奏往往被以音訊或影像的方式記錄下來,然而除了以音訊的方式,若配合影像處理及電腦演算,其亦可將此種紀錄轉換成樂器學習者所使用的琴譜來呈現。本研究使用網路上以及一些錄製的影片來進行轉譜實驗,配合簡易的影像及訊號處理有效率地將影像中的可用特徵量化,並將實驗成果與過往研究相比較。 | zh_TW |
dc.description.abstract | Online musical performances nowadays are popular as the online platforms, like Youtube or Yoku, are widely used. One specific type of performance among these is the instrument solo. Instruments solo using piano, flute, or guitar are recorded and being uploaded to the internet. Some are made as tutorial videos to teach the audiences to learn by themselves. In this paper we explore the possibility transcribing these tutorial video into readable sheet using current software technologies from signal processing and image processing, brining an improvement to the old-fashioned audio signal converting. The experiment is built upon piano solo-playing, as these kinds of performances can be found commonly on Youtube and are easier to perform the video segmentation. In the experiment the comparison between mutual information converting, the sound and video, and single information converting, which is the sound, are discussed. After the discussion, we come to a conclusion whether the adoption of correlative converting is applicable on the other instruments. | en |
dc.description.provenance | Made available in DSpace on 2021-06-17T01:21:40Z (GMT). No. of bitstreams: 1 ntu-106-R04525093-1.pdf: 2386160 bytes, checksum: 3db7c33832578ff0c60a5d20dc8cac4e (MD5) Previous issue date: 2017 | en |
dc.description.tableofcontents | 誌謝 i
摘要 ii ABSTRACT iii 目錄 iv 圖例索引 vii 表格索引 ix 第1章、 緒論 1 1.1 研究動機與目的 1 1.2 研究貢獻 2 1.3 系統流程 2 1.4 論文架構 4 第2章、 樂理及數位音訊特徵介紹 5 2.1 基本樂理及工具術語簡介 5 2.2 八度音以及移調 7 2.3 和弦 8 2.4 曲速 8 2.5 電子樂器通訊傳輸格式 9 第3章、 琴鍵按壓辨識方法 10 3.1 實驗限制 10 3.2 相關文獻回顧 11 3.3 本實驗系統與方法 12 3.3.1 琴鍵區域提取 12 3.3.2 琴鍵計算器(Key Calculator) 16 3.3.3 琴鍵映射(Mapper) 19 3.3.4 特徵量化 19 3.3.5 特徵訊號處理 22 第4章、 結果比較 27 4.1 與第三方軟體之結果比較 27 4.1.1 複音研究 27 4.1.2 Digital Ear 28 4.1.3 WIDI 29 4.1.4 結果比對 30 4.2 與過去實驗之結果比較 32 4.3 實驗成果展示 34 4.3.1 John Legend – All of me (Pieces) 34 4.3.2 卡農(片段) 36 第5章、 結論 38 5.1 整合歸納 38 5.2 未來改善重點 38 5.2.1 光線環境 38 5.2.2 門檻值 38 5.2.3 樂譜 40 REFERENCE 41 | |
dc.language.iso | zh-TW | |
dc.title | 影像處理應用於鋼琴琴鍵打譜 | zh_TW |
dc.title | Apply Image Recognition to the Musical Composition Using Piano | en |
dc.type | Thesis | |
dc.date.schoolyear | 105-2 | |
dc.description.degree | 碩士 | |
dc.contributor.coadvisor | 張瑞益 | |
dc.contributor.oralexamcommittee | 張恆華,陳俊銘 | |
dc.subject.keyword | 按鍵判別,樂器數位介面,影像處理,訊號分析, | zh_TW |
dc.subject.keyword | Note on detection,musical interface,image processing,signal analysis, | en |
dc.relation.page | 43 | |
dc.identifier.doi | 10.6342/NTU201702873 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2017-08-10 | |
dc.contributor.author-college | 工學院 | zh_TW |
dc.contributor.author-dept | 工程科學及海洋工程學研究所 | zh_TW |
顯示於系所單位: | 工程科學及海洋工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-106-1.pdf 目前未授權公開取用 | 2.33 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。