請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/70397
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 羅仁權(Ren C. Luo) | |
dc.contributor.author | Hao Wang | en |
dc.contributor.author | 王昊 | zh_TW |
dc.date.accessioned | 2021-06-17T04:27:17Z | - |
dc.date.available | 2023-08-15 | |
dc.date.copyright | 2018-08-15 | |
dc.date.issued | 2018 | |
dc.date.submitted | 2018-08-14 | |
dc.identifier.citation | [1] D. Lee, N. Ku , T. Kim, W. Kim, J. Lee, Y., & Y. S. Son. (2011). “Development and application of an intelligent welding robot system for shipbuilding,” Robotics and Computer-Integrated Manufacturing, 27(2), 377-388.
[2] W. Dong. “Current situation and development trend of welding robot,” (II.) [J]. Welding machine, 2006,4:43~46 [3] P. S. Shiakolas, K.L. Conrad, T. C. Yih, “On the accuracy, repeatability, and degree of influence of kinematics parameters for industrial robots,” International journal of modeling and simulation 22(4), 245- 254(2002) [4] J. Huissoon, “Method and device for robot tool frame calibration”, 6044308, 2000. [5] C. Chen and A. Kak, “Modeling and calibration of a structured light scanner for 3-D robot vision,” Proceedings. 1987 IEEE International Conference on Robotics and Automation, 1987, pp. 807-815. [6] A. Filion, A. Joubair, A. Tahan and I. Bonev, “Robot calibration using a portable photogrammetric system”, Robotics and Computer- Integrated Manufacturing, vol. 49, pp. 77-87, 2017. [7] J. Motta, G. de Carvalho and R. McMaster, “Robot calibration using a 3D vision-based measurement system with a single camera”, Robotics and Computer-Integrated Manufacturing, vol. 17, no. 6, pp. 487-497, 2001. [8] D. Whitney, C. Lozinski and J. Rourke, “Industrial Robot Forward Calibration Method and Results”, Journal of Dynamic Systems, Measurement, and Control, vol. 108, no. 1, p. 1, 1986. [9] M. Kuo. (2017). Human-Robot Collaborative Task Execution with Contact and Non-Contact Obstacle Avoidance Control. Post-graduate. National Taiwan University, Graduate Institute of Electrical Engineering. [10] J. P. Merlet, 2004. Solving the forward kinematics of a Gough-type parallel manipulator with interval analysis.International Journal of Robotics Research 23(3):221–236. [11] H. Zhuang, Y. Jiahua,, and O. Masory, 1998. Calibration of Stewart platforms and other parallel manipulators by minimizing inverse kinematic residuals. Journal of Robotic Systems 15:395–405. [12] L.S. Ginani, JMST. Motta. Theoretical and practical aspects of robot calibration with experimental verification. Journal of the Brazilian Society of Mechanical Sciences and Engineering 2011; 33:15–21. [13] C. Gong, J. Yuan, J. Ni. Nongeometric error identification and compensation for robotic system by inverse calibration. International Journal of Machine Tools and Manufacture 2000; 40:2119–2137. [14] J. Borm, C. Meng. Determination of optimal measurement configurations for robot calibration based on observability measure. The International Journal of Robotics Research 1991; 10:51. [15] Z. Roth, B. Mooring, B. Ravani. An overview of robot calibration. IEEE Journal of Robotics and Automation 1987; 3(5):377–85. [16] J. Denavit, RS. Hartenberg. A kinematic notation for lower-pair mechanisms based on matrices. Transactions ASME, Journal of Applied Mechanics 1955; 22(1):215–21. [17] D.E. Whitney, C.A. Lozinski, J.M. Rourke. Industrial robot forward calibration method and results. Journal of Dynamic Systems, Measurement, and Control 1986;108(1):1–8. [18] L. Ginani, J. Motta. Theoretical and practical aspects of robot calibration with experimental verification. Journal of the Brazilian Society of Mechanical Sciences and Engineering 2011; 33(1):15–21. [19] SH. Ye, Y. Wang, YJ. Ren, DK. Li. Robot calibration using iteration and differential kinematics. Journal of Physics: Conference Series 2006;48(1): pp. 1–6. [20] C. Gong, J. Yuan, J. Ni. Nongeometric error identification and compensation for robotic system by inverse calibration. International Journal of Machine Tools and Manufacture 2000; 40(14):2119–37. [21] S. Hayati, M. Mirmirani. Improving the absolute positioning accuracy of robot manipulators. Journal of Robotic Systems 1985;2(4):397–413. [22] W. Khalil, S. Besnard Geometric calibration of robots with flexible joints and links. Journal of Intelligent and Robotic Systems 2002;34(4):357–79. [23] N. Vira, K. Lau. An extensible ball bar for evaluation of robots’ positioning performance. Journal of Robotic Systems 1987;4(6):799–814. [24] MR. Driels. Using passive end-point motion constraints to calibrate robot manipulators. Journal of Dynamic Systems, Measurement, and Control 1993; 115(3):560–6. [25] H. Ota, T. Shibukawa, T. Tooyama, Uchiyama M. Forward kinematic calibration and gravity compensation for parallel-mechanism-based machine tools. Proceedings ofthe Institution of Mechanical Engineers, Part K. Journal of MultiBody Dynamics 2002; 216(1):39–49. [26] Y. Meng, H. Zhuang. Self-calibration of camera-equipped robot manipulators. The International Journal of Robotics Research 2001; 20(11):909–21. [27] C-D. Zhang, S-M. Song Forward kinematics of a class of parallel (Stewart) platforms with closed-form solutions. Journal of Robotic Systems 1992;9(1):93–112. [28] GB. de Sousa, A. Olabi, J. Palos, O. Gibaru, “3D metrology using a collaborative robot with a laser triangulation sensor,” Procedia Manu- facturing, 132-140(2017). [29] A. Nubiola, IA.Bonev, “Absolute calibration of an ABB IRB 1600 robot using a laser tracker,” Robotics and Computer-Integrated Manufacturing, 29(1), 236-245(2013). [30] A. Nubiola, IA.Bonev, “Absolute robot calibration with a single telescoping ballbar,” Precision Engineering, 38(3), 472-480.(2014). [31] H. M¨onnich, D. Stein, J. Raczkowsky and H. W¨orn, “An automatic and complete calibration method for robotic guided laser ablation,” 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, 2010, pp. 1086-1087. [32] P. Tabuada, “Cyber-physical systems: Position paper,” NSF Workshop on Cyber-Physical Systems, 2006. [33] Y. Zhang, C. Qian, J. Lv and Y. Liu, “Agent and cyber-physical system based self-organizing and self-adaptive intelligent shopfloor ,” in IEEE Transactions on Industrial Informatics, vol. 13, no. 2, 2017, pp. 737-747. [34] O. Cardin, F. Ounnar, A. Thomas and D. Trentesaux, “Future Industrial Systems: Best Practices of the Intelligent Manufacturing and Services Systems (IMS2) French Research Group,” in IEEE Transactions on Industrial Informatics, vol. 13, no. 2, 2017, pp. 704-713. [35] W. Dai, V. N. Dubinin, J. H. Christensen, V. Vyatkin and X. Guan, “To- ward Self-Manageable and Adaptive Industrial Cyber-Physical Systems With Knowledge-Driven Autonomic Service Management ,”in IEEE Transactions on Industrial Informatics, vol. 13, no. 2, 2017, pp. 725- 736. [36] V. Jirkovsk´y, M. Obitko and V. Maˇr´ık, “Understanding Data Heterogeneity in the Context of Cyber-Physical Systems Integration,” in IEEE Transactions on Industrial Informatics, vol. 13, no. 2, 2017, pp. 660-667. [37] G. Lux and G. Reinhart, “An approach for the automated self-calibration of robot-based inspection systems,” 2015 IEEE 7th International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM), Siem Reap, 2015, pp. 106-111. [38] H. Sung, S. Lee and D. kim, “A robot-camera hand/eye self-calibration system using a planar target,” IEEE ISR 2013, Seoul, 2013, pp. 1-4. [39] J. Shi, H. Zhang, Y. Liu, D. Wang and L. Gao, “A self-calibration method for robot based on geometric constraints,” 2016 IEEE International Conference on Information and Automation (ICIA), Ningbo, 2016, pp. 1863-1867. [40] A. Martinelli, D. Scaramuzza and R. Siegwart, “Automatic self-calibration of a vision system during robot motion,” Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006, Orlando, FL, 2006, pp. 43-48. [41] D. A. Cucci and M. Matteucci, “Position tracking and sensors self- calibration in autonomous mobile robots by Gauss-Newton optimization,” 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, 2014, pp. 1269-1275. [42] W. B. Li, G. Z. Cao, J. D. Sun, Y. X. Liang and S. D. Huang, “A calibration algorithm of the structured light vision for the arc welding robot,” 2017 14th 7International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Jeju, 2017, pp. 481-483. [43] M. Dinham and G. Fang, “A low cost hand-eye calibration method for arc welding robots,” 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO), Guilin, 2009, pp. 1889-1893. [44] M. Gaudreault, A. Joubair and I. A. Bonev, “Local and closed-loop calibration of an industrial serial robot using a new low-cost 3D measuring device,” 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, 2016, pp. 4312-4319. [45] M. Dinham and G. Fang, “Low cost simultaneous calibration of a stereo vision system and a welding robot,” 2010 IEEE International Conference on Robotics and Biomimetics, Tianjin, 2010, pp. 1452-1456. [46] H. S. Oh, G. Kang, U. Kim, J. K. Seo, W. S. You and H. R. Choi, “Force/torque sensor calibration method by using deep-learning,” 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Jeju, 2017, pp. 777-782. [47] N. Pitchandi and S. P. Subramanian, “GA-based camera calibration for vision-assisted robotic assembly system,” in IET Computer Vision, vol. 11, no. 1, pp. 50-59, 2 2017. [48] W. Dong, W. Lin, C. Qian, C. Ye and H. Gao, “GA-based modified D-H method calibration modeling for 6-DOFs serial robot,” 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC), Wuhan, 2016, pp. 225-230. [49] J. Bouguet. Camera Calibration Toolbox for Matlab. http://docs.opencv.org/master/d4/d94/tutorial_camera_calibration.html [50] T. Barsakar and V. Mankar, “A novel approach for medical video compression using kernel based meanshift ROI coding techniques,” 2016 Conference on Advances in Signal Processing (CASP), Pune, 2016, pp. 212-216. [51] W. G. Aguilar, M. A. Luna, J. F. Moya, V. Abad, H. Parra and H. Ruiz, “Pedestrian Detection for UAVs Using Cascade Classifiers with Meanshift,” 2017 IEEE 11th International Conference on Semantic Computing (ICSC), San Diego, CA, 2017, pp. 509-514. [52] C. Xiu and F. Ba, “Target tracking based on the improved Camshift method,” 2016 Chinese Control and Decision Conference (CCDC), Yinchuan, 2016, pp. 3600-3604. [53] C. Xiu, Z. Chai, H. He and J. Hou, “Improved Camshift tracking method based on the edge suppression,” 2017 29th Chinese Control and Decision Conference (CCDC), Chongqing, 2017, pp. 3529-3533. [54] C. Xiu and R. Wang, “Hybrid tracking based on camshift and template matching,” 2017 29th Chinese Control And Decision Conference (CCDC), Chongqing, 2017, pp. 5753-5756. [55] D. Li, L. Xu and Y. Wu, “Improved CAMShift object tracking based on Epanechnikov Kernel Density Estimation and Kalman filter,” 2017 29th Chinese Control And Decision Conference (CCDC), Chongqing, 2017, pp. 3120-3126. [56] C. Xiu, Z. Chai, H. He and J. Hou, “Improved Camshift tracking method based on the edge suppression,” 2017 29th Chinese Control And Decision Conference (CCDC), Chongqing, 2017, pp. 3529-3533. [57] L. Jay; B. Behrad; Kao, Hung-An (2015). ”A cyber-physical systems architecture for industry 4.0-based manufacturing systems”. Manufacturing Letters. 3: 18–23. [58] E. Alpaydin, ”Decision Trees,” in Introduction to Machine Learning , 1, MIT Press, 2014, pp.213-238. [59] N. Jouppi, C. Young, N. Patil, et al. In-datacenter performance analysis of a tensor processing unit. In Proceedings of the 44th Annual International Symposium on Computer Architecture, ISCA '17, pages 1–12. ACM, 2017. [60] J. Ma, Sheridan, R. P., Liaw, A., Dahl, G. E.and Svetnik, V. Deep neural nets as a method for quantitative structure-activity relationships. J. Chem. Inf. Model. 55, 263–274 (2015). [61] O. KAYO,. LOCALLY LINEAR EMBEDDING ALGORITHM--Extensions and applications. 2006. [62] X. Feng and P. Milanfar, 'Multiscale principal components analysis for image local orientation estimation,' Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002., Pacific Grove, CA, USA, 2002, pp. 478-482. [63] C. H. Menq, J. H. Borm, and J. Z. Lai. Identification and observability measure of a basis set of error parameters in robot calibration. ASME Journal Mechamissions, and Automation in Design, 111(4):513–518, 1989. [64] A. C. Atkinson. The usefulness of optimum experimental designs. Journal of Royal Statistical Society B, 58(1):59–76, 1996. [65] J. H. Borm and C. H. Menq. Determination of optimal measurement configurations for robot calibration based on observibility measure. International Journal of Robotics Research, 10(1):51–63, 1991. [66] M. R. Driels and U. S. Pathre. Significance of observation strategy on the design of robot calibration experiments. Journal of Robotic Systems, 7(2):197–223, 1990. [67] C. H. Menq, J. H. Borm, and J. Z. Lai. Identification and observability measure of a basis set of error parameters in robot calibration. ASME Journal Mechamissions, and Automation in Design, 111(4):513–518, 1989. [68] D, David; P, Yves; M, Blaise. Choosing measurement poses for robot calibration with the local convergence method and Tabu search. The International Journal of Robotics Research, 2005, 24.6: 501-518. [69] J. H. Borm, and C. H. Menq, 1991. Determination of optimal measurement configurations for robot calibration based on observabililty measure. Journal of Robotic Systems 10(1):51–63. [70] M. R. Driels, and U. S. Pathre, 1990. Significance of observation strategy on the design of robot calibration experiments. Journal of Robotic Systems 7(2):197–223. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/70397 | - |
dc.description.abstract | 工業4.0智慧工廠的需求與工業機器人在市場上的廣泛使用, 工業網宇實體系統 (iCPS) 的發展及其擴展應用, 工業機器人的許多功能和應用都需要自我控制改進。 全自動化生產線低成本是全球製造系統的核心要求,自動校準也是其中的一部分。隨著物聯網的發展, 有大量的大型資料可以快速收集和儲存。人工智慧的發展使大資料的有效處理成為可能。
首先,針對工業的需求, 提出了一種在有限工作空間問題上解決機器人 TCP 運動絕對精度的標定方法。採用這種低成本的相機跟蹤方法, 其成本比一般用途的鐳射跟蹤裝置要低得多。採用基於深神經網路的整流線性單元方法, 可以比傳統的經驗補償法更有效地提高誤差偏移計算和標定精度。 其次,本文提出了一種比手工方法更快捷、更簡單、更便宜、更有效的刀具坐標系自動標定系統的獨立方法。所提出的方法需要使用兩個 ' Eye to hand ' 相機和一個 ' Eye in hand ' 相機捕捉圖像。然後, 通過 CamShift 和 MeanShift 演算法對圖像軌跡跟蹤和坐標系統轉換等方法獲取TCP資料, 並利用 PCA、LDA 等多種方式處理視覺資料。最優化的深神經網路方法誤差補償的機器人允許TCP自動運行與校準系統的功能。 我們已經開發了一個6度自由度的工業機器人這個實驗。建立了九種不同的 DNN 模型, 最後對現有機器人進行了適當的機器人座標誤差補償, 可自我調整、高效地實現機器人標定。此外, 還詳細介紹了選擇訓練資料的理由、DNN 模型的設計方法以及改進 DNN 模型的方案。 第三,針對全自動化生產線的工業要求, 提出了一種基於工業網宇實體系統(iCPS)的工業機器人在生產線應用的自動校準方法。對電機的 PID 控制參數進行分段, 以模擬機器在長時間內的校準精確度的狀況。利用九種深度神經網路 (DNN) 方法對大資料趨勢與機器校準評分的關係模型進行了訓練, 證明它比傳統的校準法更有效地提高了機器校準的速度和準確性。 關鍵字: 工業機器人、低成本校準工具、工業網宇實體系統 | zh_TW |
dc.description.abstract | The requirement of Industry 4.0 for smart factories and the widespread use of industrial robots in market, the development of industrial cyber-physical systems (iCPS) and its extended application, many of the functions and applications of industrial robots will require self-control improvements. Low-Cost of completely automatic production line machine is the core requirement for global manufacturing system. Automated Calibration Approach of Industrial Robot is also part of the requirements. With the development of Internet of things (IoT), there are enormous big data of production line could be collected quickly and stored in large quantities. The development of artificial intelligence makes it possible to deal with big data efficiently.
Firstly, Due to the need in the industry, this thesis presents a calibration method to resolve the absolute accuracy of robot TCP movement in a limited workspace problem. We implement this low-cost method with camera tracking which in a much lower cost fashion than general purpose laser tracking device. We use Rectified Linear Unit (ReLU) method based on deep neural network (DNN) which can be more efficient than traditional empirical compensation method in improving the error offset calculation and calibration accuracy. Secondly, this thesis presents a system independent method for automatic calibration of the tool coordinate system which is faster, simpler, cheaper and more effective than the manual method. The proposed method required images to be captured using two “eye to hand” cameras and one “eye in hand” camera. Tool center position (TCP) data is then acquired through CamShift and MeanShift algorithm for image trajectory tracking along with coordinate system conversion, several methods like PCA, LDA can deal with the vision data. Optimal Deep Neural Network (DNN) method error compensation of a robot allows TCP automatically run with the calibration system functions. We have developed 6 degrees of freedom (DoF) industrial robot for this experiment. Nine different kinds of DNN models are built and finally with suitable robot coordinate error compensation for the current robot; robot calibration can be achieved adaptively and efficiently. In addition, the justification for selecting training data, the methods for designing DNN models and the schemes for improving DNN models are also described in details. Thirdly, due to the industrial requirement of completely automatic production line, this thesis presents a method based on industrial Cyber Physical system (iCPS) to automated calibration of robot in production line application using the data produced by the robots. The PID control parameters of motors are segmented to simulate the calibration statue of the robots in a long duration. We use 9 kinds of deep neural network (DNN) methods to train the model of the relationship between the large data trend and the calibration score of the machine, it is demonstrated that it becomes more efficient than traditional calibration method to improve the speed and accuracy for robot calibration. Keywords: Industrial Robot, Low-Cost Calibration Tools, Industrial Cyber Physical System | en |
dc.description.provenance | Made available in DSpace on 2021-06-17T04:27:17Z (GMT). No. of bitstreams: 1 ntu-107-R05921094-1.pdf: 6017773 bytes, checksum: 728525ea648f210d40fdb4217d954b73 (MD5) Previous issue date: 2018 | en |
dc.description.tableofcontents | 口試委員會審定書 i
誌謝 iv 中文摘要 vi ABSTRACT viii LIST OF FIGURES xii LIST OF TABLES xv Chapter 1 Introduction 1 1.1 History 1 1.1.1 iCeiRA 6-DoF Robot Manipulator 4 1.1.2 Lightweight Payload Robot 5 1.2 Industrial Applications 6 1.2.1 Calibration 9 1.2.2 Assembly 10 1.2.3 Machining 11 1.2.4 Welding 12 1.3 Challenges 14 1.3.1 Low-Cost Calibration Tools 14 1.3.2 Robot Vision System 15 1.3.3 Deep Neural Networks (DNN) 16 1.3.4 Industrial Cyber Physical System 17 1.4 Thesis Structure 20 Chapter 2 Experimental Scenario 21 2.1 Experimental Deployment 21 2.1.1 Scenario 21 2.1.2 Camera Calibration and Calibration Board 22 2.2 Problems Encountered 23 2.3 Preconditions 29 2.3.1 Multi-objects Tracking 29 2.3.2 Dynamic Position and Pose of Calibration Trajectory Planning 30 Chapter 3 Calibration System 31 3.1 Robot Calibration Tools 31 3.2 Generalized Robot Calibration System 35 3.3 Optimized Robot Calibration System 38 Chapter 4 Algorithm and Theory 40 4.1 Algorithm 40 4.1.1 D-H parameters of Industrial Robot 40 4.1.2 Coordinate System Transformation 42 4.1.3 Cameras and Vision System 44 4.1.4 Low-cost Calibration Tools Design 46 4.1.5 Gripper 48 4.2 Main Devices of Calibration Systems 49 4.3 Calibration Functionalities 52 4.3.1 Rough Calibration 52 4.3.2 Precise Calibration 52 4.3.3 Calibration Approach 53 Chapter 5 Multi-objects Tracking 57 5.1 MeanShift 57 5.2 CamShift 58 5.3 Vision Data Generation 59 Chapter 6 Industrial Cyber Physical System 60 6.1 Physical level 61 6.1.1 Data Collection 61 6.2 Data-to-information Conversion level 61 6.2.1 JSON messages 61 6.2.2 Socket TCP/IP 62 6.3 Network level 66 6.3.1 Database 66 6.3.2 Human Machine Interface 67 6.4 Edge Computing level 69 6.4.1 Edge Computing Introduction 69 6.4.2 Deep Neural Network Design 70 6.4.3 Optimization of Deep Neural Network 77 Chapter 7 Experimental Results and Discussion 84 7.1 Camera Calibration Results 84 7.2 Real Measurement Calibration Results 85 7.3 Robot Camera Tracking Results 86 7.4 Deep Neural Network Results 89 Chapter 8 Conclusions, Contributions and Future Works 94 8.1 Conclusions 94 8.2 Contributions 96 8.3 Future Works 97 REFERENCE 100 VITA 110 | |
dc.language.iso | en | |
dc.title | 低成本工業機器人自動校準及其在工業網宇實體系統之實現 | zh_TW |
dc.title | Automated Low-Cost Calibration Approach of an Industrial Robot and its Realization on Industrial Cyber Physical System | en |
dc.type | Thesis | |
dc.date.schoolyear | 106-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 顏炳郎(Ping-Lang Yen),鄒杰烔(Jie-Tong Zou) | |
dc.subject.keyword | 工業機器人,低成本校準工具,工業網宇實體系統, | zh_TW |
dc.subject.keyword | Industrial Robot,Low-Cost Calibration Tools,Industrial Cyber Physical System, | en |
dc.relation.page | 110 | |
dc.identifier.doi | 10.6342/NTU201803304 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2018-08-14 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 電機工程學研究所 | zh_TW |
顯示於系所單位: | 電機工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-107-1.pdf 目前未授權公開取用 | 5.88 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。