請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/21126完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 江茂雄(Mao-Hsiung Chiang) | |
| dc.contributor.author | Huai-Che Chang | en |
| dc.contributor.author | 張懷哲 | zh_TW |
| dc.date.accessioned | 2021-06-08T03:27:25Z | - |
| dc.date.copyright | 2020-01-15 | |
| dc.date.issued | 2019 | |
| dc.date.submitted | 2019-12-26 | |
| dc.identifier.citation | [1] Y. Shirai and H. Inoue, 'Guiding a robot by visual feedback in assembling tasks,' Pattern recognition, vol. 5, no. 2, pp. 99-108, 1973.
[2] J. Hill, 'Real time control of a robot with a mobile camera,' in 9th Int. Symp. on Industrial Robots, 1979, 1979, pp. 233-246. [3] L. Weiss, A. Sanderson, and C. Neuman, 'Dynamic sensor-based control of robots with visual feedback,' IEEE Journal on Robotics and Automation, vol. 3, no. 5, pp. 404-417, 1987. [4] G. D. Hager, S. Hutchinson, and P. Corke, 'A tutorial on visual servo control,' IEEE Transactions on Robotics and Automation, vol. 12, no. 5, pp. 651-670, 1996. [5] W. Jang and Z. Bien, 'Feature-based visual servoing of an eye-in-hand robot with improved tracking performance,' in Proceedings. 1991 IEEE International Conference on Robotics and Automation, 1991, pp. 2254-2260: IEEE. [6] N. P. Papanikolopoulos and P. K. Khosla, 'Adaptive robotic visual tracking: Theory and experiments,' IEEE Transactions on Automatic Control, vol. 38, no. 3, pp. 429-445, 1993. [7] W. J. Wilson, C. W. Hulls, and G. S. Bell, 'Relative end-effector control using cartesian position based visual servoing,' IEEE Transactions on Robotics and Automation, vol. 12, no. 5, pp. 684-696, 1996. [8] M. Asada, T. Tanaka, and K. Hosoda, 'Visual tracking of unknown moving object by adaptive binocular visual servoing,' in Proceedings. 1999 IEEE/SICE/RSJ. International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI'99 (Cat. No. 99TH8480), 1999, pp. 249-254: IEEE. [9] J. A. Piepmeier and H. Lipkin, 'Uncalibrated eye-in-hand visual servoing,' The International Journal of Robotics Research, vol. 22, no. 10-11, pp. 805-819, 2003. [10] V. Utkin, 'Variable structure systems with sliding modes,' IEEE Transactions on Automatic control, vol. 22, no. 2, pp. 212-222, 1977. [11] J.-J. E. Slotine and W. Li, 'On the adaptive control of robot manipulators,' The international journal of robotics research, vol. 6, no. 3, pp. 49-59, 1987. [12] M.-H. Chiang and H.-T. Lin, 'Development of Three Dimensional Parallel Mechanism Robot with Pneumatic System,' IFAC Proceedings Volumes, vol. 43, no. 18, pp. 339-344, 2010. [13] H.-T. Lin, 'Design, Analysis and Path Tracking Servo Controlof 3-PUU Pneumatic Parallel Manipulators with a Stereo Vision Measurement System.' PhD diss., National Taiwan University, 2012. [14] S.-H. Kung, 'The Integration of The SURF and HRI Image Algorithm with A Three-Axial Pyramidal Pneumatic Parallel Manipulator.' Master's thesis, National Taiwan University, 2014. [15] R. Tsai, 'A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses,' IEEE Journal on Robotics and Automation, vol. 3, no. 4, pp. 323-344, 1987. [16] Z. Zhang, 'A flexible new technique for camera calibration,' IEEE Transactions on pattern analysis and machine intelligence, vol. 22, 2000. [17] CLEANPNG Color Background. Available: https://www.cleanpng.com/png-rgb-color-space-rgb-color-model-light-4170880/ [18] Recommended 8-Bit YUV Formats for Video Rendering. Available: https://docs.microsoft.com/en-us/windows/win32/medfound/recommended-8-bit-yuv-formats-for-video-rendering [19] A. Dogra and P. Bhalla, 'Image sharpening by gaussian and butterworth high pass filter,' Biomedical and Pharmacology Journal, vol. 7, no. 2, pp. 707-713, 2014. [20] N. Otsu, 'A threshold selection method from gray-level histograms,' IEEE transactions on systems, man, and cybernetics, vol. 9, no. 1, pp. 62-66, 1979. [21] H.-P. Kriegel, E. Schubert, and A. Zimek, 'The (black) art of runtime evaluation: Are we comparing algorithms or implementations?,' Knowledge and Information Systems, vol. 52, no. 2, pp. 341-378, 2017. [22] P.-S. Liao, T.-S. Chen, and P.-C. Chung, 'A fast algorithm for multilevel thresholding,' J. Inf. Sci. Eng., vol. 17, no. 5, pp. 713-727, 2001. [23] D.-Y. Huang and C.-H. Wang, 'Optimal multi-level thresholding using a two-stage Otsu optimization approach,' Pattern Recognition Letters, vol. 30, no. 3, pp. 275-284, 2009. [24] ''Appendix A: The 'Centre de Morphologie Mathématique', an overview' by Jean Serra, in (Serra et al. (Eds.) 1994), pgs. 369-374..' [25] J. Serra, Image analysis and mathematical morphology. Academic Press, Inc., 1983. [26] E. R. Dougherty, 'An introduction to morphological image processing,' SPIE, 1992, 1992. [27] P. Soille, Morphological image analysis: principles and applications. Springer Science & Business Media, 2013. [28] H. Hadwiger, 'Minkowskische addition und subtraktion beliebiger punktmengen und die theoreme von Erhard Schmidt,' Mathematische Zeitschrift, vol. 53, no. 3, pp. 210-218, 1950. [29] Blob Analysis. Available: https://www.mathworks.com/help/vision/ref/blobanalysis.html [30] L.-W. L. Mao-Hsiung CHIANG, Chung-Feng Jeffrey Kuo Yih-Nan Chen, 'A Tracking-Based Adaptive Sliding-Mode Controller for Nonlinear Pneumatic Path Tracking Systems via a Functional Approximation Approach,' Chinese Society of Mechanical Engineers, vol. 2, pp. 83-94, 2009. [31] J.-Y. Bouguet, 'Camera Calibration Toolbox for Matlab. Available: http://www.vision.caltech.edu/bouguetj/calib_doc/ [32] L.-W. Tsai, Robot analysis: the mechanics of serial and parallel manipulators. John Wiley & Sons, 1999. [33] L. E. Weiss, A. C. Sanderson, and C. P. Neuman, 'Dynamic visual servo control of robots: an adaptive image-based approach,' in Proceedings. 1985 IEEE International Conference on Robotics and Automation, 1985, vol. 2, pp. 662-668: IEEE. [34] D. Fioravanti, B. Allotta, and A. Rindi, 'Image based visual servoing for robot positioning tasks,' Meccanica, vol. 43, no. 3, pp. 291-305, 2008. [35] T. Kröger and F. M. Wahl, 'Online trajectory generation: Basic concepts for instantaneous reactions to unforeseen events,' IEEE Transactions on Robotics, vol. 26, no. 1, pp. 94-111, 2009. | |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/21126 | - |
| dc.description.abstract | 本文旨在以單一不含深度資訊之網路攝影機，加入影像演算法應用於三軸氣壓並聯式機構機械臂，進行三維度之物件追蹤控制。影像運算單元可由影像辨識得到物件面積大小、位置，完成三維方向誤差的即時計算，資料以無線網路傳送至機械手臂端之控制器，以執行動態物體之追蹤控制。
本研究發展以顏色辨識操控機械臂的方法，並使用色彩轉換消除空間中光線及陰影的干擾。網路攝影機取得影像後經過多個處理程序，最終得到座標資料，回傳機械臂端點下一瞬間之即時座標。其中的影像處理單元計算色彩轉換、雜訊消除和形態學，以計算目標物大小及位置。 機械臂控制器設計方面，為了提高控制精準度，使用以傅立葉函數近似法為基底之適應性滑動模式控制器結合 追蹤補償之控制器，對三軸無桿氣壓缸進行即時位置及軌跡控制，並利用推導出之正向運動學模型算出當前手臂端點卡氏座標，再與目標距離誤差座標相加，獲得下一取樣時間機械臂之絕對位置。 最後，經過實驗驗證本文提出之方法的可行性，證實此系統可成功導引三軸式機械臂之端點順利地即時追蹤動態目標。 | zh_TW |
| dc.description.abstract | The objective of this study is to develop a 3-dimensional object tracking with a single RGB camera on the three-axial pneumatic parallel manipulator. The image processing unit calculates the area of target and position of the centroid, therefore, to retrieve the three-dimensional errors in real-time. Simultaneously, the errors are being transmitted to the control unit through wireless internet.
In this study, a robust color recognition method is utilized to control the manipulator. Images are transformed into YCbCr model first in order to reduce the noise of light. Once the three-dimensional errors are retrieved, the information is transmitted to the manipulator controller to determine the end-point position of the next sampling time. Thus, the end-effector of the manipulator can move to track the dynamic position of the object. The image processing unit achieves the color transformation, noise elimination, morphology of structure and target position determination. In order to control the three-axial pneumatic parallel manipulator and improve the tracking accuracy, a Fourier series-based adaptive sliding mode controller with H-infinity tracking performance (FSB-ASMC+ controller) is proposed. The x-y-z errors are added to the current end-point position, which is calculated according to the forward kinematics, for the next moment movement. Finally, the experiments of the three-axial pneumatic manipulator end-effector integrated with the color recognition algorithm demonstrate that the proposed methods can achieve the dynamic object tracking successfully. | en |
| dc.description.provenance | Made available in DSpace on 2021-06-08T03:27:25Z (GMT). No. of bitstreams: 1 ntu-108-R06525053-1.pdf: 8843063 bytes, checksum: d520eb229a12daab8d817a65c92851cc (MD5) Previous issue date: 2019 | en |
| dc.description.tableofcontents | 誌謝 I
中文摘要 II ABSTRACT III CONTENTS IV LIST OF FIGURE VII LIST OF TABLES XI Chapter 1 Introduction 1 1.1 Background 1 1.2 Literature Review 3 1.3 Motivation 5 1.4 Thesis Outline 6 Chapter 2 System Overview 7 2.1 Mechanism Description 8 2.2 Test Rig Layout 11 2.2.1 Overall Manipulator System 11 2.2.2 Camera System 14 2.2.3 Data Transmission 16 Chapter 3 Object Recognition 18 3.1 Image Processing 18 3.1.1 Color Selection 19 3.1.2 Median Filter 21 3.1.3 Threshold 22 3.2 Morphology 25 3.2.1 Structuring Element 25 3.2.2 Erosion, Dilation, and Opening 26 3.2.3 Blob Analysis 29 3.3 Real World Target Processing 30 Chapter 4 Dynamic Modeling 35 4.1 Dynamic Models of Pneumatic System 35 4.1.1 Dynamic Model of Pneumatic Servo Valve 37 4.1.2 Mass Flow Rate 38 4.1.3 Continuity Equation 39 4.1.4 Equation of Motion 40 4.2 Camera Model 42 4.3 Camera Calibration 45 Chapter 5 Analysis of Kinematics 48 5.1 Geometry of Manipulator 49 5.2 Inverse Kinematic Analysis 52 5.3 Forward Kinematic Analysis 53 Chapter 6 Controller Design and Control Method 54 6.1 Function Approximation 55 6.2 Adapted Sliding Model with H-infinity Control 56 6.3 Relative Position Estimation 59 6.4 PBVS Dynamic Look and Move 62 Chapter 7 Experiments 65 7.1 Experiments of Object Searching 67 7.1.1 Predefined Trajectory 68 7.1.2 Searching and Approaching 76 7.2 Experiments of Object Tracking 83 7.2.1 X-Y Plane Tracking 83 7.2.2 Z-axial Depth Tracking 90 7.2.3 Three-dimensional Object Tracking 97 Chapter 8 Conclusions 104 REFERENCES 105 | |
| dc.language.iso | en | |
| dc.subject | 影像辨識 | zh_TW |
| dc.subject | 並聯式機構機械臂 | zh_TW |
| dc.subject | 適應性滑動模式控制 | zh_TW |
| dc.subject | 目標動態追蹤 | zh_TW |
| dc.subject | image recognition | en |
| dc.subject | object tracking | en |
| dc.subject | ASMC | en |
| dc.subject | three-axial pneumatic parallel manipulator | en |
| dc.title | 影像伺服動態追蹤控制應用於三軸氣壓並聯式平行機械臂之研究 | zh_TW |
| dc.title | Development of Visual Servo Dynamic Tracking Control for a Three-Axial Pneumatic Parallel Manipulator | en |
| dc.type | Thesis | |
| dc.date.schoolyear | 108-1 | |
| dc.description.degree | 碩士 | |
| dc.contributor.oralexamcommittee | 陳義男(Yi-Nan Chen),張恆華(Herng-Hua Chang),林浩庭(Hao-Ting Lin) | |
| dc.subject.keyword | 影像辨識,並聯式機構機械臂,適應性滑動模式控制,目標動態追蹤, | zh_TW |
| dc.subject.keyword | image recognition,three-axial pneumatic parallel manipulator,ASMC,object tracking, | en |
| dc.relation.page | 106 | |
| dc.identifier.doi | 10.6342/NTU201904431 | |
| dc.rights.note | 未授權 | |
| dc.date.accepted | 2019-12-27 | |
| dc.contributor.author-college | 工學院 | zh_TW |
| dc.contributor.author-dept | 工程科學及海洋工程學研究所 | zh_TW |
| 顯示於系所單位： | 工程科學及海洋工程學系 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| ntu-108-1.pdf 未授權公開取用 | 8.64 MB | Adobe PDF |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。