請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/65097
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 羅仁權(Ren C. Luo) | |
dc.contributor.author | Kuan-Yu Chen | en |
dc.contributor.author | 陳冠宇 | zh_TW |
dc.date.accessioned | 2021-06-16T23:24:57Z | - |
dc.date.available | 2014-08-09 | |
dc.date.copyright | 2012-08-09 | |
dc.date.issued | 2012 | |
dc.date.submitted | 2012-07-31 | |
dc.identifier.citation | [1] R. Chatila and J. Laumond, 'Position referencing and consistent world modeling for mobile robots,' in Robotics and Automation. Proceedings. IEEE International Conference on, pp. 138-145, 1985.
[2] R. Smith, M. Self, and P. Cheeseman. 'A stochastic map for uncertain spatial relationships'. In Proceedings of fourth International Symposium on Robotics Research, pages 467–474, 1988. [3] H. Durrant-Whyte and T. Bailey, 'Simultaneous localization and mapping: part I,' Robotics & Automation Magazine, IEEE, vol. 13, pp. 99-110, 2006. [4] T. Bailey and H. Durrant-Whyte, 'Simultaneous localization and mapping (SLAM): part II,' Robotics & Automation Magazine, IEEE, vol. 13, pp. 108-117, 2006. [5] K. Konolige, J. Bowman, J. Chen, P. Mihelich, M. Calonder, V. Lepetit, and P. Fua, 'View-based maps,' The International Journal of Robotics Research, vol. 29, pp. 941-957, 2010. [6] J. L. Blanco, 'Derivation and implementation of a full 6D EKF-based solution to bearing-range SLAM,' University of Malaga, Spain, Technical Report, 2008. [7] R. C. Luo, C. C. Lai, and C. C. Hsiao, 'Enriched indoor environment map building using multi-sensor based fusion approach,' in Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, pp. 2059-2064, 2010 [8] R. Sim, P. Elinas, and J. J. Little, 'A study of the Rao-Blackwellised particle filter for efficient and accurate vision-based SLAM,' International Journal of Computer Vision, vol. 74, pp. 303-318, 2007. [9] M. Montemerlo, S. Thrun, D. Koller, and B. Wegbreit, 'FastSLAM 2.0: An improved particle filtering algorithm for simultaneous localization and mapping that provably converges,' in Proceedings of the International Joint Conference on Artificial Intelligence, pp. 1151-1156, 2003. [10] F. Lu and E. Milios, 'Globally consistent range scan alignment for environment mapping,' Autonomous Robots, vol. 4, pp. 333-349, 1997. [11] D. Borrmann, J. Elseberg, K. Lingemann, A. Nuchter, and J. Hertzberg, 'Globally consistent 3D mapping with scan matching,' Robotics and Autonomous Systems, vol. 56, pp. 130-142, 2008. [12] J. L. Blanco, J. A. Fernandez-Madrigal, and J. Gonzalez, 'Toward a Unified Bayesian Approach to Hybrid Metric--Topological SLAM,' Robotics, IEEE Transactions on, vol. 24, pp. 259-270, 2008. [13] R. C. Luo, S. C. Lin, and C. C. Lai, 'Indoor autonomous mobile robot localization using natural landmark,' in Industrial Electronics, 2008. IECON 2008. 34th Annual Conference of IEEE, pp. 1626-1631, 2008. [14] F. Moreno, J. Blanco, and J. Gonzalez, 'Stereo vision-specific models for particle filter-based SLAM,' 2008. [15] A. J. Davison, I. D. Reid, N. D. Molton, and O. Stasse, 'MonoSLAM: Real-Time Single Camera SLAM,' Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 29, pp. 1052-1067, 2007. [16] Sjoerd de Jong. 'Top-down selective visual attention during SLAM'. Master thesis, University of Groningen, Department of Artificial Intelligence, March 2008. [17] S. Ahn and W. K. Chung, 'Efficient SLAM algorithm with hybrid visual map in an indoor environment,' in Control, Automation and Systems, 2007. ICCAS '07. International Conference on, 2007, pp. 663-667. [18] P.S. Maybeck. 'Stochastic models, estimation, and control'. 1979. [19] K. Murphy. 'Bayesian map learning in dynamic environments'. Advances in Neural Information Processing Systems, 12: pp. 1015–1021, 1999 [20] D.G. Lowe. 'Object recognition from local scale-invariant features'. In Proceedings of the Seventh International Conference on Computer Vision (ICCV’99), volume 2, pp. 1150–1157, 1999. [21] H. Bay , A. Ess , T. Tuytelaars , and L. V. Gool, 'Speeded-Up Robust Features (SURF) ', Computer Vision and Image Understanding, 2006, Volume 110, Issue 3, pp. 346-359 [22] E. Rosten, R. Porter, and T. Drummond, 'Faster and Better: A Machine Learning Approach to Corner Detection,' Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 32, pp. 105-119, 2010. [23] C. Harris and M. Stephens, 'A Combined Corner and Edge Detector, ' Proc. Alvey Vision Conf., pp. 147-151, 1988. [24] K. Mikolajczyk and C. Schmid, 'Indexing Based on Scale Invariant Interest Points, ' Proc. Eighth IEEE Int’l Conf. Computer Vision, vol. 1, pp. 525-531, 2001. [25] S. Jianbo and C. Tomasi, 'Good features to track,' in Computer Vision and Pattern Recognition, 1994. Proceedings CVPR , 1994 IEEE Computer Society Conference on, 1994, pp. 593-600. [26] S.M. Smith and J.M. Brady, 'SUSAN—A New Approach to Low Level Image Processing, ' Int’l J. Computer Vision, vol. 23, no. 1, pp. 45-78, 1997. [27] K. Mikolajczyk and C. Schmid. 'A performance evaluation of local descriptors'. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 27(10): pp. 1615–1630, 2005. [28] Neira, J. Tardos; Tardos, J.D. (2001), 'Data association in stochastic mapping using the joint compatibility test', Robotics and Automation, IEEE Transactions on 17 (6): pp. 890–897. [29] 游鴻修,朱怡銘,陳繼賓, 「泛用刑輪型機器人發展平台 - Ubot」,電機月刊第十七卷第六期, pp. 130-136, 2007. [30] PointGrey, 'Bumblebee Stereo Vision Camera Systems Datasheet' [31] http://chess.eecs.berkeley.edu/eecs149/documentation/differentialDrive.pdf [32] E. Rosten and T. Drummond, 'Machine learning for high-speed corner detection', European Conference on Computer Vision, poster presentation, 2006 [33] D.G. Lowe. 'Distinctive image features from scale-invariant keypoints'. International Journal of Computer Vision, 60(2): pp. 91–110, 2004. [34] http://www.cs.washington.edu/education/courses/cse576/08sp/projects/project1/artifacts/xingli08/artifact/Project1_Xing%20Li.htm [35] Barak Freedman. 'Method and system for object reconstruction'. US Patent US 2010/0118123 A1. [36] K Khoshelham. 'Accuracy analysis of kinect depth data'. GeoInformation Science, 38(5/W12):1{6, 2010. [37] M.R. Andersen, T. Jensen, P. Lisouski, A.K. Mortensen, M.K. Hansen, T. Gregersen and P. Ahrendt: 'Kinect Depth Sensor Evaluation for Computer Vision Applications,' 2012. Department of Engineering, Aarhus University. Denmark. 37 pp. - Technical report ECE-TR-6 [38] N. Dalal and B. Triggs, 'Histograms of oriented gradients for human detection,' in Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, 2005, pp. 886-893 vol. 1. [39] http://75.98.78.94/default.aspx [40] 'NITE Algorithms 1.3 Note', PrimeSense Inc., 2010 [41] R. C. Luo, N. W. Chang, S. C. Lin, S. C. Wu, 'Human Tracking and Following Using Sensor Fusion Approach for Mobile Assistive Companion Robot,' Industrial Electronics, 2009. IECON ’09. 35th Annual Conference of IEEE, pp.2235-2240, 3-5 Nov. 2009 [42] R.E. Kalman. 'Contributions to the theory of optimal control'. Bol. Soc. Mat. Mexicana: 102–119, 1960. [43] R.E. Kalman. 'A New Approach to Linear Filtering and Prediction Problems'. Journal of Basic Engineering: pp. 35–45, 1960. [44] R.E. Kalman; R.S. Bucy. 'New results in linear filtering and prediction theory'. Journal of Basic Engineering: pp. 95–108, 1961. [45] G. Welch, and G.Bishop, “An Introduction to the Kalman Filter”, 1997 [46] J.A. Castellanos, J. Neira, and J.D. Tard’os. 'Limits to the consistency of EKF-based SLAM.' In IFAC Symposium on Intelligent Autonomous Vehicles, 2004. [47] S. Huang and G. Dissanayake, 'Convergence analysis for extended Kalman filter based SLAM,' in Robotics and Automation, 2006. ICRA 2006. Proceedings 2006 IEEE International Conference on, 2006, pp. 412-417. [48] E. A. Wan and R. Van Der Merwe, 'The unscented Kalman filter for nonlinear estimation,' in Adaptive Systems for Signal Processing, Communications, and Control Symposium 2000. The IEEE AS-SPCC, 2000, pp. 153-158. [49] M. W. M. G. Dissanayake, P. Newman, S. Clark, H. F. Durrant-Whyte, and M. Csorba, 'A solution to the simultaneous localization and map building (SLAM) problem,' Robotics and Automation, IEEE Transactions on, vol. 17, pp. 229-241, 2001. [50] M. Montemerlo and S. Thrun, 'Simultaneous localization and mapping with unknown data association using FastSLAM,' in Robotics and Automation, 2003. Proceedings. ICRA '03. IEEE International Conference on, 2003, pp. 1985-1991 vol.2. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/65097 | - |
dc.description.abstract | 隨著科技發展,自動化產品已經成為人們生活中不可或缺的一部分,伴隨著高齡化時代的來臨,機器人會漸漸地進入人們的日常生活中,智慧型服務機器人便是為此目的而開發。服務型機器人必須要有在環境中移動與自我定位的能力,以達到與環境或人們互動的應用。
本論文的目的在於設計一個利用視覺特徵點作為位置參考的同步定位與建置地圖並同時結合人機互動功能的系統,可以藉由與人互動的同時記錄背景的視覺特徵點,並加以處理作為定位的參考,達到機器人自主化的目的。論文中的實驗主要分為兩大部分,第一部分主要是驗證當機器人在進行同步定位與建置地圖時,若有人進入機器人的視覺範圍中,會對定位的結果會造成怎樣的影響。第二部分則是將第一部分驗證的結果結合人機互動,使得機器人可以一邊跟隨使用者,一邊進行環境的探索,建構地圖。 本論文利用FAST演算法找出特徵點位置,使用雙眼立體視覺與Kinect獲得視覺特徵點之立體座標,並提出特徵點緩衝器的概念濾除不穩定的特徵點,以減輕系統運算的負擔,另外也提出了特徵點相位的想法,用來區分聚集在一起的特徵點,使得資料匹配有較明顯的唯一性。在人體偵測方面採用了方向梯度直方圖(Histogram of oriented gradient)與Kinect的深度資料找出人的位置並跟隨人移動,同時並濾除位於人體身上的特徵點,降低定位誤差與加快運算速度。最後利用拓展型卡曼濾波器(Extended Kalman Filter)來融合感應器與制動器的誤差,推算出機器人與地標可能的所在位置並繪出環境地圖。本論文所提出的軟體架構與設計模式都是以標準 C/C++ 程式語言,結合 MRPT (The mobile robot programming toolkit)與OPENNI函式庫於Visual Studio軟體平台中進行開發。 | zh_TW |
dc.description.abstract | With development of technology, automation products have been an indispensable part in human’s daily lives. Along with the aging era, robot will come into our daily lives gradually. Intelligent service robot is developed for this purpose. Service robot should have ability to move and self-localization in unknown environment, so that it would achieve the application to interact with human or its surrounding.
The purpose of this thesis is to develop a system which uses visual landmarks as position reference to locate itself and build the surrounding map simultaneously. The system also consists of human robot interaction aspect. Through interacting with human, the robot records visual landmarks and locate itself to satisfy autonomy demand. The experiments are separated into two main parts in this thesis. The first part is designed to verify if human enter the visual range of robot during executing V-SLAM, what will be the impact on result. The second part is combining the result of first part and human robot interaction together. Let robot follow people and construct the map of its surrounding simultaneously. This thesis employs FAST corner detector to extract the location of feature points and obtains 3D coordinates by stereo vision and Kinect. We propose a concept named “feature buffer”, and the feature buffer would filter out temporary feature points, and it reduces computational loading of system. Besides, we also propose an idea about “feature orientation”. Feature orientation would distinguish the landmarks clustering together and enhance the uniqueness of landmarks, so that we would get better result of data association. In this thesis the Histogram of oriented gradient (HOG) and the depth data of Kinect are used as human detector. The human detector finds out the location of human, and the system uses this information to remove the feature points on human body and also employs this information to follow people. Finally, we use the Extended Kalman Filter (EKF) to fuse the error of sensor and odometer. After fusing, the possible locations of robot and landmarks are calculated, and the map of the environment is constructed. In this thesis all the systems models and software frameworks are implemented with C/C++ programming language, MRPT (The mobile robot programming toolkit), and OPENNI library, and all of them are integrated and developed in Visual Studio. | en |
dc.description.provenance | Made available in DSpace on 2021-06-16T23:24:57Z (GMT). No. of bitstreams: 1 ntu-101-R99921009-1.pdf: 2964491 bytes, checksum: 44d91cee49145299e7339ee983e48176 (MD5) Previous issue date: 2012 | en |
dc.description.tableofcontents | 誌謝 I
中文摘要 II Abstract III Table of Contents V List of Figures VII List of Tables IX Chapter 1 Introduction 1 1.1 Era of Robot 1 1.2 Motivation and Objectives 2 1.3 Literature Review 3 1.4 Thesis Organization 8 Chapter 2 SLAM Background 9 2.1 History of the SLAM Problem 9 2.2 Solutions to the SLAM Problem 10 2.2.1 SLAM with Kalman Filter 11 2.2.2 SLAM with Particle Filter 12 2.3 Visual Interesting Points 13 2.3.1 Feature Detection 14 2.3.2 Feature Description 15 2.3.3 Feature Matching 16 Chapter 3 Experiment Platform 18 3.1 Hardware 18 3.1.1 UBot and Kinematics Control 19 3.1.2 Bumblebee 23 3.1.3 Kinect 25 3.2 Software System Architecture 27 3.2.1 Human Body Elimination 28 3.2.2 Human Following 30 Chapter 4 Feature Extraction Method 32 4.1 FAST Corner Detector 32 4.2 The Concept of SIFT Orientation 35 4.3 Feature Orientation 36 4.4 Depth Information 39 4.4.1 Bumblebee 39 4.4.2 Kinect 41 4.5 Feature Point Buffer 45 Chapter 5 Human Detection and Following Methods 47 5.1 Histogram of Oriented Gradients 47 5.2 Kinect 49 5.3 Human Following Strategy 52 Chapter 6 Extended Kalman Filter 54 6.1 Extended Kalman Filter Principle 54 6.2 Extended Kalman Filter Implementation 57 6.3 Criteria of Data Association 61 Chapter 7 Experimental Results 64 7.1 Bumblebee with Human Body Elimination 64 7.1.1 Scenario 64 7.1.2 Results 64 7.2 Kinect for Human Following 67 7.2.1 Scenario 67 7.2.2 Results 67 7.3 Discussion 70 Chapter 8 Conclusions and Contributions 73 8.1 Conclusions and Contributions 73 8.2 Future Works 74 References 76 VITA 82 | |
dc.language.iso | en | |
dc.title | 結合人機互動與視覺同步定位與地圖建立系統於服務型機器人之應用 | zh_TW |
dc.title | Human Robot Interaction with Vision-Based Simultaneous Localization and Mapping for Service Robotics | en |
dc.type | Thesis | |
dc.date.schoolyear | 100-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 馮蟻剛(I-Kong Fong),鄭榮偉(J. W. Cheng) | |
dc.subject.keyword | 視覺同步定位與地圖建置,拓展型卡曼濾波器,智慧型服務機器人,數位影像處理,人機互動, | zh_TW |
dc.subject.keyword | vision-based simultaneous localization and mapping,Extended Kalman Filter,intelligent service robot,digital image processing,human robot interaction, | en |
dc.relation.page | 82 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2012-08-01 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 電機工程學研究所 | zh_TW |
顯示於系所單位: | 電機工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-101-1.pdf 目前未授權公開取用 | 2.9 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。