請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/29296
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 傅立成(Li-Chen Fu) | |
dc.contributor.author | Yi-Chung Cheng | en |
dc.contributor.author | 鄭一中 | zh_TW |
dc.date.accessioned | 2021-06-13T01:04:05Z | - |
dc.date.available | 2015-09-21 | |
dc.date.copyright | 2011-09-21 | |
dc.date.issued | 2011 | |
dc.date.submitted | 2011-08-21 | |
dc.identifier.citation | [1] S. Goldin-Meadow, 'The role of gesture in communication and thinking', Trends in Cognitive Sciences, vol. 3, pp. 419-429, 1999.
[2] Jeen-Shing Wang, Yu-Liang Hsu, Jiun-Nan Liu, 'An Inertial-Measurement-Unit-Based Pen With a Trajectory Reconstruction Algorithm and Its Applications,' IEEE Transactions on Industrial Electronics, vol.57, no.10, pp.3508-3521, Oct. 2010. [3] H.-I Suk, Bong-Kee Sin, Seong-Whan Lee, 'Robust modeling and recognition of hand gestures with dynamic Bayesian network,' 19th International Conference on Pattern Recognition, (ICPR’08), pp.1-4, 2008. [4] Jiayang Liu, Zhen Wang, Lin Zhong, Jehan Wickramasuriya, Venu Vasudevan, 'uWave: Accelerometer-based personalized gesture recognition and its applications,' IEEE International Conference on Pervasive Computing and Communications, pp. 1-9, 2009. [5] C.H. Lin, E.W. Huang, and L.C. Fu, 'Fast Accelerometer-Based Continuous Gesture Recognition Using Kernel-Based Matching Method', International Conference on Human-Computer Interaction, Springer, 2009. [6] Chun Zhu and Weihua Sheng, “Online Hand Gesture Recognition Using Neural Network Based Segmentation”, IEEE/RSJ International Conference on Intelligent Robots and Systems. October 2009, pp. 2415 - 2420. [7] Juha Kela, Panu Korpipaa, Jani Mantyjarvi, Sanna Kallio, Giuseppe Savino, Luca Jozzo and Sergio Di Marc, “Accelerometer-Based Gesture Control for a Design Environment” Personal and Ubiquitous Computing, pp. 285–299, vol. 10 , num. 5. August 2005, [8] Sanna Kallio, Juha Kela, Jani Mantyjarvi , 'Online gesture recognition system for mobile interaction,' IEEE International Conference on Systems, Man and Cybernetics, vol.3, pp. 2070- 2076, 2003 [9] Jani Mantyjarvi, Juha Kela, Panu Korpipaa, and Sanna Kallio. “Enabling fast and effortless customisation in accelerometer based gesture interaction”. Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia (MUM '04). ACM, 25-31, 2004. [10] Paul S. Bradley and Usama M. Fayyad. “Refining Initial Points for K-Means Clustering”, Proceedings of the Fifteenth International Conference on Machine Learning (ICML '98), pp. 91-99, 1998. [11] Dong-Xia Chang, Xian-Da Zhang, and Chang-Wen Zheng. ”A genetic algorithm with gene rearrangement for K-means clustering”, Pattern Recognition, vol. 42, issue. 7, pp. 1210-1222, 2009. [12] K., M. Krishna, Narasimha Murty, 'Genetic K-means algorithm,' IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol.29, no.3, pp.433-439, 1999. [13] L. Hall, I. B. Ozyurt, J. C. Bezdek, 'Clustering with a genetically optimized approach,' IEEE Transactions on Evolutionary Computation, vol.3, no.2, pp.103-112, 1999. [14] J. Beak and Byoung-Ju Yun, “A Sequence-Action Recognition Applying State Machine for User Interface”, IEEE Transactions on Consumer Electronics, vol. 54, issue 2, pp. 719-726 , May 2008 [15] H. Brashear, Starner, T., Lukowicz, P., Junker, H., 'Using multiple sensors for mobile sign language recognition,' Proceedings of the Seventh IEEE International Symposium on Wearable Computers, pp. 45- 52, 18-21 Oct. 2005. [16] Xing-Han Wu, Mu-Chun Su, and Pa-Chun Wang, “A Hand-Gesture-Based Control Interface for a Car-Robot”, IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4644 - 4648, October 2010. [17] J. Lichtenauer, E. Hendriks, and M. Reinders, “Sign language recognition by combining statistical DTW and independent classification,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 11, pp. 2040–2046, 2008. [18] J. Alon, V. Athitsos, Q. Yuan, and S. Sclaroff, “A unified framework for gesture recognition and spatiotemporal gesture segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 9, pp. 1685–1699, 2009. [19] J. Ward, P. Lukowicz, and G. Troster, 'Gesture spotting using wrist worn microphone and 3-axis accelerometer,' Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies Grenoble, France: ACM, 2005. [20] S. Calinon and A. Billard, 'Recognition and reproduction of gestures using a probabilistic framework combining PCA, ICA and HMM,' Proceedings of the 22nd international conference on Machine learning ACM, 2005. [21] L. Kratz, M. Smith, and F. J. Lee, 'Wiizards: 3D gesture recognition for game play input,' Proceedings of the 2007 conference on Future Play Toronto, Canada: ACM, 2007. [22] T. Schlomer, B. Poppinga, N. Henze, and S. Boll, 'Gesture recognition with a Wii controller,' Proceedings of the 2nd international conference on Tangible and embedded interaction, ACM, 2008. [23] Hyeon-Kyu L and J. H. Kim, 'An HMM-based threshold model approach for gesture recognition,' Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 21, pp. 961-973, 1999. [24] H. Yang, A. Park, and S. Lee, 'Gesture spotting and recognition for human-robot interaction,' IEEE transactions on Robotics, vol. 23, pp. 256-270, 2007. [25] Daniel Kelly, John McDonald, and Charles Markham, ” Recognition of Spatiotemporal Gestures in Sign Language Using Gesture Threshold HMMs”, Machine Learning for Vision-Based Motion Analysis, Advances in Pattern Recognition, Part 4, pp.307-348, 2011. [26] Mahmoud Elmezain, Ayoub Al-Hamadi, Samy Sadek, Bernd Michaelis, ”Robust Methods for Hand gesture Spotting and Recognition Using Hidden Markov Models and Conditional Random Fields” IEEE International Symposium on Signal Processing and Information Technology, pp. 131-136, 2010. [27] Bo Peng and Gang Qian, “Online Gesture Spotting From Visual Hull Data”, IEEE Transactions on Pattern Analysis and Machine Intelligence, issue. 99, 2010. [28] A. Ramamoorthy, N. Vaswani, S. Chaudhury, and S. Banerjee. Recognition of dynamic hand gestures. Pattern Recognition, pp. 2069–2081, 2003. [29] T. Schlomer, D. Roggen, and G. Troster, 'Gestures are strings: Efficient online gesture spotting and classification using string matching,' International conference on Body area networks table of contents, 2007. [30] Chun Zhu and Weihua Sheng, ”Wearable Sensor-Based Hand Gesture and Daily Activity Recognition for Robot-Assisted Living”. IEEE Transactions on Systems, Man and Cybernetics, Issue.99, pp. 1-5,2011. [31] Gonzalo Bailador, Daniel Roggen, Gerhard Troster, and Gracian Trivino, “Real time gesture recognition using Continuous Time Recurrent Neural Networks”, Proceedings of the ICST 2nd international conference on Body area networks, pp. 15:1-15:8, 2007. [32] Deyou Xu, “A Neural Network Approach for Hand Gesture Recognition in Virtual Reality Driving Training System of SPG”, 18th International Conference on Pattern Recognition, vol.3, pp. 519-522, 2006. [33] G. Murthy and R. Jadon. Hand gesture recognition using neural networks. In Proceedings of IEEE 2nd Annual International Advanced Computing Conference, pp. 134 -138, 2010. [34] Rainer Storn and Kenneth Price, “Differential Evolution – A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces”. Journal of Global Optimization. Vol. 11, issue. 4, pp. 341-359, 2007. [35] J. MacQueen, 'Some Methods for classification and Analysis of Multivariate Observations', Proceedings of fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281-297, 1967. [36] Leonard E. Baum, and T. Petrie, “Statistical inference for probabilistic functions of finite state Markov chains”. Annals of Mathematical Statistics, vol. 37, pp. 1559–1563, 1966. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/29296 | - |
dc.description.abstract | 為使人機互動能更加地直覺便利,不少研究藉由慣性感測器,開發出手勢辨識系統來讓人和機器互動。在這篇論文當中,我們分析Wii Remote和 Wii MotionPlus當中的加速規和陀螺儀所感測到的加速度和角速度,並利用這些訊號辨識出使用者所表現的手勢。不同於以往直接辨識完整的訊號,我們首先根據手勢呈現的角度,將完整的手勢訊號拆解成不同的子手勢。除此之外,我們提出了一種改良式的k-means分群演算法,利用差異演化演算法 (Differential Evolutionary Algorithm) 來找出最佳的分群初始點,此改良式的k-means分群演算法被用來量化每個子手勢以降低手勢當中的變異性。最後,我們利用兩層的階層式隱馬可夫模型 (hierarchical hidden Markov model) 來辨識使用者所表現的手勢。其中,第一層的隱馬可夫模型被用來辨識一個完整手勢當中所包含的子手勢,而辨識過的結果會進一步被重組,當成第二層隱馬可夫模型的輸入,做第二階段的辨識。為了驗證我們所提出的方法,我們設計出一個包含12種不同手勢的手勢庫來做測試,實驗結果顯示出我們提出的手勢辨識技術可以在平均81 ms的時間內成功地辨識出使用者所表現的手勢,其正確性高達94%。 | zh_TW |
dc.description.abstract | To make the human computer interaction (HCI) more intuitive and convenient, numerous works have been applying inertial sensor-based gesture recognition to remotely interact with the computer. In this thesis, we analyze the data sensed by the accelerometer and gyroscope in the Wii Remote which is attached by the Wii MotionPlus to recognize the currently performed human gesture. Instead of directly analyzing the raw data sequences, we take a different approach to decompose the complete gesture trajectory into several sub-gesture trajectories according to the “orientation angle” of the gesture. Furthermore, a modified k-means clustering algorithm which uses the differential evolutionary algorithm to select the optimal initial points is used to model each sub-gesture in order to cope with the intra- and inter-variations of the gestures. Finally, a two-layer hierarchical hidden Markov model (HHMM) is adopted to recognize the gesture where the lower layer HMM is used to recognize the sub-gestures, and the results of the lower layer HMM are assembled and input to the upper layer HMM for the second stage recognition. To validate the proposed approach, we here design a gesture set which consists of ten different gestures and is more than most of the other datasets. The experimental results show that the recognition process of our system takes about 81 ms and the recognition rate is higher than 94%. | en |
dc.description.provenance | Made available in DSpace on 2021-06-13T01:04:05Z (GMT). No. of bitstreams: 1 ntu-100-R98922021-1.pdf: 1692221 bytes, checksum: 91df9a4be038fc91494462e68a674203 (MD5) Previous issue date: 2011 | en |
dc.description.tableofcontents | 口試委員會審定書 #
誌謝 i 中文摘要 ii ABSTRACT iii CONTENTS iv LIST OF FIGURES vi LIST OF TABLES viii Chapter 1 Introduction 1 1.1 Motivation 1 1.2 Objectives 4 1.3 Challenges 5 1.4 Related Works 7 1.4.1 Gesture Model Construction 8 1.4.2 Gesture Classification 13 1.5 Contributions 15 1.6 Organization 17 Chapter 2 Problem Definition and Preliminaries 19 2.1 Problem Definition 19 2.2 System Overview 21 2.3 Preliminaries 26 2.3.1 Min-Max Scaling 26 2.3.2 Linear Length Normalization 27 2.3.3 Differential Evolutionary Algorithm 29 2.3.4 K-Means Clustering Algorithm 33 2.3.5 Hidden Markov Model 35 Chapter 3 Gesture Analysis and Gesture Structure Construction 44 3.1 Overview 44 3.2 Gesture Structure Definition and Construction 45 3.3 Gesture Structure Refinement 54 3.4 Gesture Structure Quantization 56 3.5 Gesture Model Construction 59 Chapter 4 Gesture Recognition 60 4.1 Overview 60 4.2 Gesture Spotting 61 4.3 Gesture Classification 63 Chapter 5 Experiments 68 5.1 Environmental Description 68 5.2 Gesture Sample Collection 69 5.3 Experimental Result 71 5.3.1 Performance of Our Gesture Quantization Method 71 5.3.2 Performance of Our Gesture Classification Method 75 | |
dc.language.iso | en | |
dc.title | 應用在人機互動當中基於慣性感測器的一種新的手勢辨識技術 | zh_TW |
dc.title | A New Approach to Inertial Sensor-Based Gesture Recognition for Human Computer Interaction | en |
dc.type | Thesis | |
dc.date.schoolyear | 99-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 蘇木春(Mu-Chun Su),洪一平(Yi-Ping Hung),李蔡彥(Tsai-Yen Li),莊永裕(Yung-Yu Chuang) | |
dc.subject.keyword | 手勢辨識,差異演化演算法,隱馬可夫模型,加速規,陀螺儀, | zh_TW |
dc.subject.keyword | Gesture Recognition,Differential Evolutionary Algorithm,Hidden Markov Model,Accelerometer,Gyroscope, | en |
dc.relation.page | 92 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2011-08-21 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 資訊工程學研究所 | zh_TW |
顯示於系所單位: | 資訊工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-100-1.pdf 目前未授權公開取用 | 1.65 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。