請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/65281
標題: | 以深度影像及三維樣板比對為基礎之即時頭部運動軌跡追蹤 Depth-Based Real Time Head Motion Tracking Using 3D Template Matching |
作者: | Yu Tu 屠愚 |
指導教授: | 歐陽明(Ming Ouhyoung) |
關鍵字: | 即時頭部運動軌跡追蹤,深度影像,三維樣板比對,迭代最佳化,最小平方法, Real-Time Head Motion Tracking,Depth Image,Kinect,3D Template Matching,Iterative Optimization,Least Square Method, |
出版年 : | 2012 |
學位: | 碩士 |
摘要: | 在本篇論文中,我們對於以深度影像為基礎達成即時頭部軌跡追蹤之問題提出了兩種不同的方法。在方法一中,我們在深度圖上對使用者的正臉取樣產生點雲(Point Cloud),並使用這些點雲以最小平方法計算出最佳近似的平面,再將臉部輪廓以最小平方法計算出最佳近似的橢圓,以此平面之法向量及橢圓之傾斜角計算出頭部之旋轉角度。在方法二中,我們使用梯度坡降法迭代地將特定距離函數進行最佳化,此方法可算出更精準的旋轉角度及移動距離。我們所提出的這兩個方法,在單一CPU運算下皆可達到30fps的計算速度。在此系統所使用之攝影器材─Microsoft Kinect以及Asus Xtion Pro,乃較為普及、平價、易取得且易使用的深度攝影機,其優點亦伴隨著較高的拍攝雜訊。為了使系統得以不被環境光線改變所影響,我們只利用其拍攝出之深度影像為輸入來源做計算。在本篇論文中,我們證明,三維空間中,六個自由度的即時頭部軌跡追蹤,是可以經由分析帶有雜訊之深度影像達成的。 In this thesis, we propose a system to estimate head poses only using depth information in real-time. Two methods are developed. First, assuming that a head can be approximated by a bounding box, we find the best fitted plane for the frontal face by the least square error method. Thus, the normal vector of this plane represents the head orientation. Second, an optimization method based on 3D model fitting is developed. We iteratively minimize the distance between source and target point clouds of a user's head. This method is more robust and the results are more precise. Both of the proposed methods give fully real-time responses (30fps) without needing the GPU speedup. We adopt a commodity depth sensor named Microsoft Kinect as well as Asus Xtion, and use the depth image as the only input so that our system will not be affected by illumination variations. The simplicity of this acquisition device comes at the cost of frequent noises in the acquired data. We demonstrate that 6 degree of freedom real-time head motion tracking in 3D space can be achieved with noisy depth data. |
URI: | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/65281 |
全文授權: | 有償授權 |
顯示於系所單位: | 資訊工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-101-1.pdf 目前未授權公開取用 | 25.24 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。