請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/92025
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 陳亮嘉 | zh_TW |
dc.contributor.advisor | Liang-Chia Chen | en |
dc.contributor.author | 陳俞安 | zh_TW |
dc.contributor.author | Yu-An Chen | en |
dc.date.accessioned | 2024-02-27T16:37:20Z | - |
dc.date.available | 2024-02-28 | - |
dc.date.copyright | 2022-03-15 | - |
dc.date.issued | 2021 | - |
dc.date.submitted | 2002-01-01 | - |
dc.identifier.citation | [1] Robotic Vision System. https://www.abingerrave.xyz/products.aspx?cname=robotic+vision+system&cid=7. Accessed: 2021-07-30.
[2] H. Hirschmuller. Stereo vision in structured environments by consistent semi-global matching. In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), volume 2, pages 2386–2393, 2006. [3] Chu Toan Thang. Multifrequency digital fringe projection profilometry using a novel hybrid phase unwrapping strategy. Master’s thesis, National Taipei University of Technology, Taipei, 2018. [4] Hongjun Dai and Xianyu Su. Shape measurement by digital speckle temporal sequence correlation with digital light projector. Optical Engineering, 40(5):793 – 800, 2001. [5] Miles Hansard, Seungkyu Lee, Ouk Choi, and Radu Horaud. Time of Flight Cameras: Principles, Methods, and Applications. SpringerBriefs in Computer Science, October 2012. [6] Liang-Chia Chen and Thanh-Hung Nguyen. A novel surface descriptor for automated 3d object recognition and localization. Sensors, 19(4), 2019. [7] Martin A. Fischler and Robert C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 24(6):381–395, June 1981. [8] Ruwen Schnabel, Roland Wahl, and Reinhard Klein. Efficient ransac for point-cloud shape detection. Computer Graphics Forum, 26(2):214–226, June 2007. [9] John Canny. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8(6):679–698, 1986. [10] Frédéric Devernay. A non-maxima suppression method for edge detection with sub-pixel accuracy. INRIA Research Report, 2724, 11 1995. [11] Rafael Grompone von Gioi and Gregory Randall. A Sub-Pixel Edge Detector: an Implementation of the Canny/Devernay Algorithm. Image Processing On Line, 7:347–372, 2017. [12] Madhav Moganti, Fikret Ercal, Cihan H. Dagli, and Shou Tsunekawa. Automatic pcb inspection algorithms: A survey. Computer Vision and Image Understanding, 63(2):287–313, 1996. [13] A. Hubeli and M. Gross. Multiresolution feature extraction for unstructured meshes. In Proceedings Visualization, 2001. VIS ’01., pages 287–294, 2001. [14] Klaus Hildebrandt, Konrad Polthier, and Max Wardetzky. Smooth feature lines on surface meshes. In Symposium on Geometry Processing, pages 85–90, 01 2005. [15] Watanabe Kouki and Alexander Belyaev. Detection of salient curvature features on polygonal surfaces. Comput. Graph. Forum, 20, 09 2001. [16] Mark Pauly, Richard Keiser, and Markus Gross. Multi‐scale feature extraction on point‐sampled surfaces. Computer Graphics Forum, 22:281 – 289, 09 2003. [17] Dena Bazazian, Josep R. Casas, and Javier Ruiz-Hidalgo. Fast and robust edge extraction in unorganized point clouds. In 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA), pages 1–8, 2015. [18] M. Pauly, M. Gross, and L.P. Kobbelt. Efficient simplification of point-sampled surfaces. In IEEE Visualization, 2002. VIS 2002., pages 163–170, 2002. [19] Stefan Gumhold, Xinlong Wang, and Rob MacLeod. Feature extraction from point clouds. Proceedings of 10th international meshing roundtable, 2001, 11 2001. [20] Kris Demarsin, Denis Vanderstraeten, Tim Volodine, and Dirk Roose. Detection of closed sharp edges in point clouds using normal estimation and graph theory. Computer-Aided Design, 39(4):276–283, 2007. [21] Liang-Chia Chen, Ching-Wen Liang, Dinh-Cuong Hoang, Duc-Hieu Duong, Chin-Sheng Chen, and Shyh-Tsong Lin. A novel feature detection method using multi-dimensional image fusion for automated optical inspection on critical dimension. Journal of the Chinese Society of Mechanical Engineers, 39:145–152, 04 2018. [22] Bastian Steder, Radu Rusu, Kurt Konolige, and Wolfram Burgard. Point feature extraction on 3d range scans taking into account object boundaries. In ICRA, pages 2601–2608, 05 2011. [23] Ying Wang, Daniel Ewert, Daniel Schilberg, and Sabina Jeschke. Edge extraction by merging 3d point cloud and 2d image data. In 2013 10th International Conference and Expo on Emerging Technologies for a Smarter World (CEWIT), pages 1–6, 2013. [24] Carl de Boor. On calculating with b-splines. Journal of Approximation Theory, 6(1):50–62, 1972. [25] Lies A. Piegl and Wayne Tiller. The NURBS Book. Springer-Verlag Berlin Heidelberg, 2nd edition, 1997. [26] Gerald Farin. Curves and Surfaces for Computer-Aided Geometric Design. Academic Press, Boston, 3rd edition, 1993. [27] Wenping Wang, Helmut Pottmann, and Yang Liu. Fitting b-spline curves to point clouds by curvature-based squared distance minimization. ACM Trans. Graph., 25:214–238, 04 2006. [28] Thomas Mörwald. Object modelling for cognitive robotics. PhD thesis, Vienna University of Technology, April 2013. [29] Liang-Chia Chen, Manh-Trung Le, and Chih-Jer Lin. Robot-based 3d machine vision using circular-feature normal estimation and multidimensional image fusion. In 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics(AIM), pages 248–253, 2019. [30] Manh-Trung Le. Research and Development on Reconstruction of Accurate 3-D Surfaces with Sharp Edges Using Digital Structured Light Projection and Multi-Dimensional Image Fusion. PhD thesis, National Taipei University of Technology, Taiwan, June 2017. [31] Manh-Trung Le, Liang-Chia Chen, and Chih-Jer Lin. Reconstruction of accurate 3-d surfaces with sharp edges using digital structured light projection and multi-dimensional image fusion. Optics and Lasers in Engineering, 96:17–34, 2017. [32] R. Rusu, Zoltán-Csaba Márton, Nico Blodow, Mihai Emanuel Dolha, and M. Beetz. Towards 3d point cloud based object maps for household environments. Robotics Auton. Syst., 56:927–941, 2008. [33] DLP3010EVM-LC. https://www.ti.com/tool/DLP3010EVM-LC. Accessed: 2021-07-30. [34] Basler ace acA2440-75um - Area Scan Camera. https://www.baslerweb.com/en/products/cameras/area-scan-cameras/ace/aca2440-75um/. Accessed: 2021-07-30. | - |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/92025 | - |
dc.description.abstract | 三維光學量測技術由於具備量測物體深度與不易受量測視角變化影響的性質,在自動化檢測領域中有許多二維量測無法與其相比的優勢。然而三維光學量測在碰上銳利邊緣或深度的急遽變化時,因為難以捕捉該處的反射光,經常導致重建出的三維點雲邊緣經常出現量測雜訊及資料破碎的情況,進而產生量測誤差。
本文提出一種結合三維與二維方式新的量測演算法,目標為結合三維可量測深度以及二維易於判斷邊緣位置的優勢,以重建出可量測關鍵尺寸的三維形貌資訊。首先使用結構光投影獲得原始三維點雲,藉由前處理去除雜訊與其他不必要的資料,得到目標尺寸所在之表面點雲。接著透過邊緣偵測法從二維影像獲得二維邊緣資訊,將其於相機模型中的投影與表面點雲擬合之B-spline曲面相交,以得到物體邊緣在三維空間中的關鍵位置,進一步獲得自動化光學檢測所需的關鍵尺寸。 為了測試此方法重建邊緣的可行性與可靠度,進行實際量測數種不同性質的樣本及其尺寸,並與三次元座標接觸式量測儀及既有之三維點雲邊緣偵測法所得之結果進行比較。從實驗結果可知,提出之演算法能夠以優於0.07 %的精度測量寬度、距離等關鍵尺寸,在量測難度更高的曲面特徵也有0.12 %的誤差百分比。證明本研究可重建出精確三維邊緣及擷取可靠之關鍵尺寸。 | zh_TW |
dc.description.abstract | With its excellent ability to measure the depth of object profile and insensitive to viewing angles, 3D optical metrology has unique advantages in the field of automated optical inspection over 2D measurement. However, when 3D optical metrology measures onto sharp edges or sudden changes of a surface, it becomes rather difficult to capture the reflected light, leading to undesired measured errors, thus obtaining unacceptable surface and inaccurate critical dimensions.
In this work, the proposed method integrates 3D and 2D measurement into a fused imaging method, in order to obtain depth detection by 3D imaging and critical dimension by 2D imaging simultaneously. First, the original 3D point cloud is acquired by structured light projection, and the surface point cloud of the target is obtained by pre-processing to remove image noises. Following this, the 2D surface edges or contours are extracted from the two-dimensional image using the proposed edge detection. By projecting the 2D edge along the camera view direction which is defined by the calibrated camera model, The geometric intersection between the projecting edge vector and the extrapolated B-spline surface generated from the surface point cloud represents the 3D surface edge or contour underlying measurement. To verify the feasibility and reliability of the proposed method, several samples with different geometric properties and critical dimensions were measured and compared with the results obtained by a calibrated coordinate measuring machine, as well as other existing methods. Verified by the experimental results, the proposed algorithm is able to measure the critical dimensions for width and distance with measured errors less than 0.07 % for regular analytic surfaces, and 0.12 % for freeform surfaces. It is demonstrated that this proposed method has capability for the reconstruction of accurate 3D surface edges and the extraction of object critical dimensions. | en |
dc.description.provenance | Submitted by admin ntu (admin@lib.ntu.edu.tw) on 2024-02-27T16:37:20Z No. of bitstreams: 0 | en |
dc.description.provenance | Made available in DSpace on 2024-02-27T16:37:20Z (GMT). No. of bitstreams: 0 | en |
dc.description.tableofcontents | 致謝 I
摘要 II Abstract III 目錄 V 圖目錄 VIII 表目錄 XI 符號目錄 XII 第一章 緒論 1 1.1 研究背景 1 1.2 研究動機 2 1.3 研究目標 3 1.4 論文架構 5 第二章 文獻回顧 7 2.1 介紹 7 2.2 三維深度資訊量測 7 2.2.1 立體視覺 8 2.2.2 結構光投影 9 2.2.3 數位影像相關係數 10 2.2.4 飛時測距 11 2.3 三維擬合方法 12 2.3.1 表面積特徵描述法 12 2.3.2 隨機抽樣一致法 14 2.4 二維邊緣檢測方法 15 2.4.1 Canny 邊緣偵測 15 2.4.2 Devernay 次像素邊緣修正 15 2.5 二維瑕疵檢測方法 17 2.5.1 影像比對法 17 2.5.2 模型比對法 17 2.6 三維邊緣偵測與重建方法 18 2.6.1 點雲幾何性質 19 2.6.2 距離影像 21 2.6.3 曲面擬合重建 24 2.7 文獻回顧之總結 26 第三章 研究方法 27 3.1 三維點雲取像 29 3.1.1 針孔相機模型與相機校正 29 3.1.2 相位高度轉換 30 3.1.3 三維座標轉換 33 3.2 點雲前處理 35 3.2.1 雜訊移除 35 3.2.2 歐幾里德距離分群法 37 3.2.3 平面模型擷取 38 3.2.4 區域生長分割法 39 3.3 二維邊緣偵測 41 3.4 三維邊緣重建 42 3.4.1 B-Spline 曲面 42 3.4.2 二維邊緣與三維曲面相交 45 3.4.3 三維邊緣平滑化 46 3.5 三維特徵擷取 48 3.5.1 自由曲面上的圓特徵 48 3.6 研究方法結論 49 第四章 實驗與結果分析 51 4.1 實驗系統架構 51 4.2 光學探頭重複度實驗 53 4.3 塊規寬度量測 55 4.4 圓孔距離量測 62 4.5 自由曲面上的圓直徑量測 68 4.6 滑鼠槽寬量測 75 第五章 結論與未來展望 81 5.1 結論 81 5.2 未來展望 82 參考文獻 83 附錄A — 三次元量測儀量測數據 87 附錄B — 實驗原始數據 90 B.1 5mm 塊規寬度量測 90 B.1.1 三維邊緣重建法 90 B.1.2 共變異數分析法 91 B.2 電路板圓孔距離量測 92 B.2.1 三維邊緣重建法 92 B.2.2 共變異數分析法 92 B.3 自由曲面圓量測 93 B.3.1 三維邊緣重建法 93 B.3.2 共變異數分析法 93 B.4 滑鼠槽寬量測 94 B.4.1 三維邊緣重建法 94 B.4.2 共變異數分析法 94 | - |
dc.language.iso | zh_TW | - |
dc.title | 以多維影像融合進行表面邊緣重建與關鍵尺寸量測 | zh_TW |
dc.title | Multi-dimensional image fusion for surface edge reconstruction and critical dimension measurement | en |
dc.type | Thesis | - |
dc.date.schoolyear | 110-2 | - |
dc.description.degree | 碩士 | - |
dc.contributor.oralexamcommittee | 鍾添東;章明;葉勝利;何昭慶 | zh_TW |
dc.contributor.oralexamcommittee | Tien-Tung Chung;Ming Chang;Sheng-Li Ye;Chao-Ching Ho | en |
dc.subject.keyword | 光學量測,三維光學檢測,三維邊緣重建,關鍵尺寸,影像融合, | zh_TW |
dc.subject.keyword | optical metrology,3D measurement,surface edge reconstruction,critical dimension,image fusion, | en |
dc.relation.page | 94 | - |
dc.identifier.doi | 10.6342/NTU202200241 | - |
dc.rights.note | 同意授權(限校園內公開) | - |
dc.date.accepted | 2022-02-12 | - |
dc.contributor.author-college | 工學院 | - |
dc.contributor.author-dept | 機械工程學系 | - |
顯示於系所單位: | 機械工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-110-2.pdf 目前未授權公開取用 | 35.9 MB | Adobe PDF | 檢視/開啟 |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。