請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/51298
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 連豊力(Feng-Li Lian) | |
dc.contributor.author | Chung-En Liu | en |
dc.contributor.author | 劉仲恩 | zh_TW |
dc.date.accessioned | 2021-06-15T13:29:48Z | - |
dc.date.available | 2020-08-21 | |
dc.date.copyright | 2020-08-21 | |
dc.date.issued | 2020 | |
dc.date.submitted | 2020-08-10 | |
dc.identifier.citation | Vishakh Duggal, Mohak Sukhwani, Kumar Bipin, G. Syamasundar Reddy, K. Madhava Krishna, 'Plantation Monitoring and Yield Estimation using Autonomous Quadcopter for Precision Agriculture,' in Proceedings of IEEE International Conference on Robotics and Automation, Stockholm, Sweden, pp. 5121-5127, May 16-21, 2016 Haoyu Zhang, Sandor Veres, Andreas Kolling, 'Simultaneous Search and Monitoring by Unmanned Aerial Vehicles,' in Proceedings of IEEE 56th Conference on Decision and Control, Melbourne, Australia, pp. 903-910, Dec. 12-15, 2017 Helen Oleynikova, Zachary Taylor, Roland Siegwart, and Juan Nieto, 'Safe Local Exploration for Replanning in Cluttered Unknown Environments for Microaerial Vehicles,' IEEE Robotics And Automation Letters, Vol. 3, No. 3, pp. 1474-1481, Jul. 2018 Fei Gao, Yi Lin and Shaojie Shen, 'Gradient-Based Online Safe Trajectory Generation for Quadrotor Flight in Complex Environments,' in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Vancouver, BC, Canada, pp. 3681-3688, Sep. 24-28, 2017 Kelly Steich, Mina Kamel, Paul Beardsley, Martin K. Obrist, Roland Siegwart, and Thibault Lachat, 'Tree Cavity Inspection Using Aerial Robots,' in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Daejeon, Korea, pp. 4856-4862, Oct. 9-14, 2016 Anurag Sai Vempati, Mina Kamel, Nikola Stilinovic, Qixuan Zhang, Dorothea Reusser, Inkyu Sa, Juan Nieto, Roland Siegwart, and Paul Beardsley, 'PaintCopter: An Autonomous UAV for Spray Painting on Three-Dimensional Surfaces,' IEEE Robotics and Automation Letters, Vol. 3, No. 4, pp. 2862-2871, Oct. 2018 Geetesh Dubey, Sankalp Arora and Sebastian Scherer, 'DROAN - Disparity-space Representation for Obstacle AvoidaNce,' in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Vancouver, BC, Canada, pp. 1324-1330, Sep. 24-28, 2017 Fang Liao, Shupeng Lai, Yuchao Hu Jinqiang Cui, Jian Liang Wang, Rodney Teo and Feng Lin, '3D Motion Planning for UAVs in GPS-Denied Unknown Forest Environment,' in Proceedings of IEEE Intelligent Vehicles Symposium, Gothenburg, Sweden, pp. 246-251, Jun. 19-22, 2016 S herif A. S. Mohamed, Mohamed-Hashem Haghbayan, Tomi Westerlund, Jukka Heikkonen, Hannu Tenhunen, and Juha Plosila, “A Survey on Odometry for Autonomous Navigation Systems,” IEEE Access, Vol. 7, pp. 97466-97486, Aug. 2019 Georg Klein and David Murray, “Parallel Tracking and Mapping for Small AR Workspaces,” in Proceedings of International Symposium on Mixed and Augmented Reality, Boston, Massachusetts, USA, pp. 225-234, 2007 Christoforos Kanellakis and George Nikolakopoulos, “Survey on Computer Vision for UAVs: Current Developments and Trends,” Journal of Intelligent Robotic Systems volume, Vol. 87, pp. 141-168, Jan. 2017 Tong Qin, Peiliang Li, and Shaojie Shen, 'VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator,' IEEE Transactions on Robotics, Vol. 34, No. 4, pp. 1004-1020, Aug. 2018 Aolei Yang, Yu Luo, Ling Chen, and Yulin Xu (2017) Survey of 3D Map in SLAM: Localization and Navigation. Communications in Computer and Information Science. Vol 761, pp. 410-420. Available: https://link.springer.com/content/pdf/10.1007%2F978-981-10-6370-1_41.pdf Cesar Cadena, Luca Carlone, Henry Carrillo, Yasir Latif, Davide Scaramuzza, Jose Neira, Ian Reid, and John J. Leonard, “Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age,” IEEE Transactions on Robotics, Vol. 32, No. 6, pp. 1309-1332, Dec. 2016 Mo Shan, Yingcai Bi, Hailong Qin, Jiaxin L, Zhi Gao, Feng Lin, and Ben M. Chen, “A Review of Visual-Inertial Simultaneous Localization and Mapping from Filtering-Based and Optimization-Based Perspectives,” in Proceedings of IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society, Florence, Italy, pp. 6049-6054, Oct. 23-26, 2016 Chang Chen, Hua Zhu, Menggang Li, and Shaoze You, “A Review of Visual-Inertial Simultaneous Localization and Mapping from Filtering-Based and Optimization-Based Perspectives,” Robotics, robotics:7030045, Aug. 2018 Aolei Yang, Yu Luo, Ling Chen, and Yulin Xu (2017) Survey of 3D Map in SLAM: Localization and Navigation. Communications in Computer and Information Science. Vol 761, pp. 410-420. Available: https://link.springer.com/content/pdf/10.1007%2F978-981-10-6370-1_41.pdf Armin Hornung, Kai M. Wurm, Maren Bennewitz, Cyrill Stachniss, and Wolfram Burgard, 'OctoMap: A Probabilistic, Flexible, and Compact 3D Map Representation for Robotic Systems,' Autonomous Robots, Vol. 34, No. 3, pp. 189-206, Apr. 2013 Kai M. Wurm, Daniel Hennes, Dirk Holz, Radu B. Rusu, Cyrill Stachniss, Kurt Konolige, and Wolfram Burgard, 'Hierarchies of octrees for efficient 3D mapping,' in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA, USA, pp. 6311-6318, Sep. 25-30, 2011 Gabriele Costante, Christian Forster, Jeffrey Delmerico, Paolo Valigi, and Davide Scaramuzza, “Perception-aware Path Planning,” arXiv:1605.04151, Feb. 10, 2017 Alexander Brunker, Thomas Wohlgemuth, Michael Frey, and Frank Gauterin, “Odometry 2.0: A Slip-Adaptive EIF-Based Four-Wheel-Odometry Model for Parking,” IEEE Transactions on Intelligent Vehicles, Vol. 4, No. 1, pp. 114-126, Mar. 2019 Raul Mur-Artal, J. M. M. Montiel and Juan D. Tardos, “ORB-SLAM: A Versatile and Accurate Monocular SLAM System,” IEEE Transactions on Robotics, Vol. 31, No. 5, pp. 1147-1163, Oct. 2015 Mahdi Abolfazli Esfahan, Han Wang, Keyu Wu, and Shenghai Yuan, “AbolDeepIO: A Novel Deep Inertial Odometry Network for Autonomous Vehicles,” IEEE Transactions on Intelligent Transportation Systems (Early Access), pp. 1-10, Apr. 2019 Ji Zhang and Sanjiv Singh, 'LOAM: Lidar Odometry and Mapping in Real-time,' in Proceedings of Robotics: Science and Systems Conference, Berkeley, CA, USA, pp. 109-111, Jul. 12-16, 2014 Vladyslav Usenko, Jakob Engel, Jörg Stückler, and Daniel Cremers, 'Direct Visual-Inertial Odometry with Stereo Cameras,' in Proceedings of IEEE International Conference on Robotics and Automation, Stockholm, Sweden, pp. 1885-1892, May 16-21, 2016 Jeffrey Delmerico and Davide Scaramuzza, 'A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots,' in Proceedings of IEEE International Conference on Robotics and Automation, Brisbane, Australia, pp. 2502-2509, May 21-25, 2018 Ke Sun, Kartik Mohta, Bernd Pfrommer, Michael Watterson, Sikang Liu, Yash Mulgaonkar, Camillo J. Taylor, and Vijay Kumar, 'Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight,' IEEE Robotics And Automation Letters, Vol. 3, No. 2, pp. 965-972, Jan. 2018 Raúl Mur-Artal and Juan D. Tardós, 'Visual-Inertial Monocular SLAM With Map Reuse,' IEEE Robotics And Automation Letters, Vol. 2, No. 2, pp. 796-803, Apr. 2017 Michael Bloesch, Sammy Omari, Marco Hutter, and Roland Siegwart, 'Robust Visual Inertial Odometry Using a Direct EKF-Based Approach,' in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Hamburg, Germany, pp. 298-304, Sep. 28-Oct. 2, 2015 Nilesh S. Gopaul, Jianguo Wang, and Baoxin Hu, 'Loosely coupled visual odometry aided inertial navigation system using discrete extended Kalman filter with pairwise time correlated measurements,' in Proceedings of 2017 Forum on Cooperative Positioning and Service, Harbin, China, pp. 283-288, May. 19-21, 2017 Julian Surber, Lucas Teixeira, and Margarita Chli, 'Robust Visual-Inertial Localization with Weak GPS Priors for Repetitive UAV Flights,' in Proceedings of IEEE International Conference on Robotics and Automation, Singapore, pp. 6300-6306, May 29 – Jun. 3, 2017 Stefan Leutenegger, Simon Lynen, Michael Bosse, Roland Siegwart, and Paul Furgale, 'Keyframe-based visual–inertial odometry using nonlinear optimization,' The International Journal of Robotics Research, Vol. 34, No. 3, pp. 314-334, 2015 Richard A. Newcombe, Steven J. Lovegrove, and Andrew J. Davison, 'DTAM: Dense tracking and mapping in real-time,' in Proceedings of IEEE International Conference on Computer Vision, Barcelona, Spain, pp. 2320-2327, Nov. 6-13, 2011 David Droeschel, Jörg Stückler, and Sven Behnke, 'Local multiresolution representation for 6D motion estimation and mapping with a continuously rotating 3D laser scanner,' in Proceedings of IEEE International Conference on Robotics and Automation, Hong Kong, China, pp. 5221-5226, May 31-Jun. 7, 2014 Helen Oleynikova, Zachary Taylor, Marius Fehr, Juan Nieto, and Roland Siegwart, 'Voxblox: Building 3D Signed Distance Fields for Planning,' arXiv preprint arXiv:1611.0363, Nov. 11, 2016 Andreas Bircher, Mina Kamel, Kostas Alexis, Helen Oleynikova, and Roland Siegwart, 'Receding Horizon “Next–Best–View” Planner for 3D Exploration,' in Proceedings of IEEE International Conference on Robotics and Automation, Stockholm, Sweden, pp. 1462-1468, May 16-21, 2016 Christian Witting, Marius Fehr, Rik Bähnemann, Helen Oleynikova, and Roland Siegwart, 'History-aware Autonomous Exploration in Confined Environments using MAVs,' in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Madrid, Spain, pp. 5208-5215, Oct. 1-5, 2018 Zichao Zhang and Davide Scaramuzza, 'Perception-aware Receding Horizon Navigation for MAVs,' in Proceedings of IEEE International Conference on Robotics and Automation, Brisbane, Australia, pp. 2534-2541, May 21-25, 2018 J. Engel, T. Schops, and D. Cremers, “LSD-SLAM: Large-scale direct monocular SLAM,” in Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland, 2014 Takafumi Taketomi, Hideaki Uchiyama, and Sei Ikeda (2017) Visual SLAM algorithms: a survey from 2010 to 2016. IPSJ Transactions on Computer Vision and Applications. Available: https://link.springer.com/content/pdf/10.1007%2F978-981-10-6370-1_41.pdf Anastasios I. Mourikis and Stergios I. Roumeliotis, 'A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation,' in Proceedings of IEEE International Conference on Robotics and Automation, Roma, Italy, pp. 3565-3572, Apr. 10-14, 2007 Adrian Carrio, Sai Vemprala, Andres Ripoll, Srikanth Saripalli and Pascual Campoy, 'Drone Detection Using Depth Maps,' in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Madrid, Spain, pp.1032-1037, Oct. 1-5, 2018 Marcin Odelga, Paolo Stegagno, Nicholas Kochanek, and Heinrich H. Bulthoff, 'A Self-contained Teleoperated Quadrotor: On-board State-Estimation and Indoor Obstacle Avoidance,' in Proceedings of IEEE International Conference on Robotics and Automation, Brisbane, Australia, pp. 7840-7847, May 21-25, 2018 Muhammad Emaduddin, Khalid Al-Mutib, Mansour Al-Sulaiman, Hedjar Ramdane, and Ebrahim Mattar, 'Accurate ground detection and segmentation for indoor navigation using RGB+D and stereo cameras,' International Conference on Image Processing, Computer Vision, and Pattern Recognition, Jul. 16-19, 2012 Yinxiao Li and Stanley T. Birchfield, ' Image-Based Segmentation of Indoor Corridor Grounds for a Mobile Robot,' in Proceedings of IEEE International Conference on Intelligent Robots and Systems, Taipei, Taiwan, pp. 837-843, Oct. 18-22, 2010 Ma Ling, Wang Jianming, Zhang Bo, and Wang Shengbei, ' Automatic Ground Segmentation for Indoor Robot Navigation,' in Proceedings of International Conference on Signal Processing Systems, Dalian, China, pp. 684-689, Jul. 5-7, 2010 Paolo Salaris, Marco Cognetti, Riccardo Spica, and Paolo Robuffo Giordano, “Online Optimal Perception-Aware Trajectory Generation,” IEEE Transactions on Robotics, Vol. 35, No. 6, pp. 1307-1322, Dec. 2019 Seyed Abbas Sadat, Kyle Chutskoff, Damir Jungic, Jens Wawerla, and Richard Vaughan, 'Feature-Rich Path Planning for Robust Navigation of MAVs with Mono-SLAM,' in Proceedings of IEEE International Conference on Robotics and Automation, Hong Kong, China, pp. 3870-3875, May 31-Jun 7, 2014 Esmaeil S. Nadimi, Tomás Cerný, Sung-Ryul Kim, and Wei Wang, 'Two-Step Clustering of SIFT Keypoints and Relaxation Based Matching of Clusters,' Proceedings of the 2015 Conference on research in adaptive and convergent systems, Prague, Czech Republic, October 9-12, 2015 Rainer Kümmerle, Giorgio Grisetti, Hauke Strasdat, Kurt Konolige, and Wolfram Burgard, 'g2o: A General Framework for Graph Optimization,' in Proceedings of IEEE International Conference on Robotics and Automation, Shanghai, China, pp. 3607-3613, May 9-13, 2011 Teresa A. Vidal-Calleja, Alberto Sanfeliu, and Juan Andrade-Cetto, 'Action Selection for Single-Camera SLAM,' IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 40, No. 6, pp. 1567-1581, Dec. 2010 Nvidia, Inc. JETSON Nano. [Online]. Available: https://www.nvidia.com/zh-tw/autonomous-machines/embedded-systems/jetson-nano/ Tong Qin, Peiliang Li, Zhenfei Yang, and Shaojie Shen (2017, Dec.). A Robust and Versatile Monocular Visual-Inertial State Estimator. GitHub respository. [Online]. Available: https://github.com/HKUST-Aerial-Robotics/VINS-Mono Kai M. Wurm and Armin Hornung (2009). OctoMap - An Efficient Probabilistic 3D Mapping Framework Based on Octrees. GitHub respository. [Online]. Available: https://github.com/OctoMap/octomap Raspberrypi. org Camera Module. [Online]. Available: https://www.raspberrypi.org/documentation/hardware/camera/ Intel, Inc. Intel RealSense Depth Camera D435. [Online]. Available: https://store.intelrealsense.com/buy-intel-realsense-depth-camera-d435.html | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/51298 | - |
dc.description.abstract | 本篇論文為無人載具主動同步定位與地圖建構之系統,透過主動找尋最佳視野方向的方式,降低單眼視覺同步定位與地圖建構之定位誤差,並建立多解析度分析地圖。在此系統中,無人載具倚賴單眼視覺慣性達成定位,並將角點偵測影像傳回電腦以求出下一個最佳的視角方向來減少定位誤差。多解析度分析地圖是基於結合定位以及彩色深度攝影機的點雲資訊建立的。本篇論文的貢獻在於,藉由最佳化下一個視角來提升無人載具在無特定結構環境中的定位準確度並建立一個基於周圍物體距離的多解析度分析地圖。 整套系統由六個平行運算的程序組成。VINS-Mono程序藉由彩色影像和慣性測量資訊提供無人載具的定位資訊。RealSense程序負責提供周邊環境的點雲資訊。Octomap程序將定位資訊和不同解析度的點雲資訊結合在一起,以建立多解析度分析地圖。感知意識導航程序藉由求出下一個最佳化的視角,提升無人載具在無特定結構環境中的定位準確度。位置控制器藉由提供基於無人載具和給定終點的距離成比例的速度。偏擺控制器界定可以轉動的範圍並負責提供偏擺的速度。 最後,本論文透過實驗結果來展示此系統的可行性以及性能。 | zh_TW |
dc.description.abstract | In this thesis, an active monocular SLAM system for a mobile robot is proposed with an aim to minimize pose estimation errors and construct a multi-resolution map of the surrounding environment. In this system, the system uses visual-inertial odometry for localization and further processes the feature detection image to compute the best viewpoint for pose error minimization. The multi-resolution map is constructed by fusing pose estimations with pointcloud from an RGB-D camera. The key contributions of this thesis include improved mobile robot localization in poorly textured environments through viewpoint optimization and detailed environment reconstruction while considering the distance of the surrounding objects. The system consists of six programs running parallel, each acting individually but play an important role in either localization or mapping. The VINS-Mono program localizes the robot by fusing IMU measurements with RGB images. Pointclouds of the surrounding environment, with decreasing resolution for objects further away from the robot, are output from the RealSense program and further combined with VINS-Mono localization for map construction. The Octomap program fuses octomaps of different resolution and probabilities to generate a probabilistic map of the navigation space with respect of object distance and hazardous. The Perception Aware Strategy program equips the system with the ability of minimizing pose errors while navigating in textureless environments. A next-best viewpoint is continuously generated based on the number and position of the detected features. The pose controller program provides the robot with velocities proportionate to the untraveled distances while considering the effects of high velocities on visual-inertial pose estimation. The yaw controller program outputs angular velocities to the robot and bounds the view of the robot with camera parameters to prevent increasing pose estimation errors due to excessive orientation. Analysis on experiments is provided to demonstrate the effectiveness of the proposed system. | en |
dc.description.provenance | Made available in DSpace on 2021-06-15T13:29:48Z (GMT). No. of bitstreams: 1 U0001-1008202012513300.pdf: 18069263 bytes, checksum: e59b2f0d48d4f89528fb5832f6222e21 (MD5) Previous issue date: 2020 | en |
dc.description.tableofcontents | 摘要 i ABSTRACT iii CONTENTS vi LIST OF FIGURES viii LIST OF TABLES xiv Chapter 1 Introduction 1 1.1 Motivation 2 1.2 Problem Formulation 4 1.2.1 Vehicle Localization in 3D space 5 1.2.2 Perception Aware Navigation 6 1.2.3 Multi-resolution Map Construction 6 1.3 Contributions 7 1.4 Organization of the Thesis 9 Chapter 2 Background and Literature Survey 11 2.1 Simultaneous Localization and Mapping (SLAM) 11 2.2 Localization 12 2.2.1 Visual-Inertial Odometry 13 2.3 Mapping 16 2.4 Active SLAM 18 Chapter 3 Related Algorithms 20 3.1 Pinhole Camera Model 20 3.2 Monocular Visual-Inertial State Estimator (VINS-Mono) 23 3.3 Octomap 28 3.4 K-means Clustering 30 Chapter 4 System Overview 31 4.1 Coordinate Frames 31 4.1.1 The VINS-Mono Coordinate Frame 31 4.1.2 The Octomap Coordinate Frame 33 4.1.3 The Turtlebot Coordinate Frame 34 4.2 System Architecture 36 Chapter 5 Perception Aware Navigation 40 5.1 Perception Aware Viewpoint Planning 40 5.1.1 Ground Removal 41 5.1.2 Viewpoint Optimization Strategy 45 5.1.3 Maximum Orientation Policy 50 5.2 Vehicle Navigation 52 5.2.1 Waypoints 53 5.2.2 Position Controller 55 5.2.3 Yaw Controller 57 Chapter 6 Multi-minimum Resolution Octomaps 59 6.1 Single Minimum Resolution Octomap Construction 59 6.2 Filtering and Map Merging 61 Chapter 7 Experimental Results and Analysis 64 7.1 Experimental Setup 64 7.1.1 Hardware Platform 64 7.1.2 Software Platform 69 7.2 Perception Aware Navigation with the Turtlebot Mecanum 70 7.2.1 Long-narrow Corridor Scenario 76 7.2.2 Open Region with Diagonal Trajectories 100 7.2.3 Curved Trajectories 139 7.2.4 Extreme Handcrafted Scenario 187 7.3 Multi-resolution Maps 211 7.3.1 Resolution and Map size 211 7.3.2 Static and Dynamic Environments 215 7.3.3 Exploration SLAM Results 217 7.4 Summary 237 7.4.1 Long-narrow Corridor Scenario 237 7.4.2 Open Region with Diagonal Trajectories 239 7.4.3 Curve Trajectories 241 7.4.4 Extreme Handcrafted Scenario 242 7.4.5 Multi-resolution Maps 244 Chapter 8 Conclusions and Future Works 246 8.1 Conclusions 246 8.2 Future Works 248 References 251 | |
dc.language.iso | en | |
dc.title | 基於單眼視覺慣性與環境感知之無人載具環境探索與地圖建立 | zh_TW |
dc.title | Monocular Visual-Inertial-Based Navigation for Mobile Robots with Perception Aware Exploration and Map Construction | en |
dc.type | Thesis | |
dc.date.schoolyear | 108-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 李後燦(Hou-Tsan Lee),黃正民(Cheng-Ming Huang),許志明(Chih-Ming Hsu) | |
dc.subject.keyword | 主動同步定位與地圖建構,單眼視覺同步定位與地圖建構,定位,多解析度分析地圖,感知意識導航,無人載具, | zh_TW |
dc.subject.keyword | Monocular SLAM,active SLAM,localization,multi-resolution map,perception aware navigation,mobile robot, | en |
dc.relation.page | 257 | |
dc.identifier.doi | 10.6342/NTU202002787 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2020-08-10 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 電機工程學研究所 | zh_TW |
顯示於系所單位: | 電機工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
U0001-1008202012513300.pdf 目前未授權公開取用 | 17.65 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。