請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/48356
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 王傑智 | |
dc.contributor.author | Hao-Hsueh Wang | en |
dc.contributor.author | 王顥學 | zh_TW |
dc.date.accessioned | 2021-06-15T06:53:43Z | - |
dc.date.available | 2013-02-20 | |
dc.date.copyright | 2011-02-20 | |
dc.date.issued | 2011 | |
dc.date.submitted | 2011-02-11 | |
dc.identifier.citation | Amberg, B., Romdhani, S., & Vetter, T. (2007). Optimal step nonrigid icp algorithms for surface registration. In IEEE Conference on Computer Vision and Pattern Recognition.
Besland, P. J., McKay, & D., N. (1992). A method for registration of 3-d shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 239–256. Blanz, V., Scherbaum, K., & Seidel, H.-P. (2007). Fitting a morphable model to 3d scans of faces. In IEEE International Conference on Computer Vision. Blanz, V. & Vetter, T. (1999). A morphable model for the synthesis of 3d faces. In SIGGRAPH ’99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques. Blanz, V. & Vetter, T. (2003). Face recognition based on fitting a 3d morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 1063–1074. Bustard, J. & Nixon, M. (2010). 3d morphable model construction for robust ear and face recognition. In IEEE Conference on Computer Vision and Patern Recognition. Cai, Q., Gallup, D., Zhang, C., & Zhang, Z. (2010). 3d deformable face tracking with a commodity depth camera. In European Conference on Computer Vision. Chen, C.-W. & Wang, C.-C. (2008). 3d active appearance model for aligning faces in 2d images. In Proceedings of the IEEE / RSJ International Conference on Intelligent Robots and Systems. Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001). Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6), 681 – 685. Cootes, T. F., Wheeler, G. V.,Walker, K. N., & Taylor, C. J. (2002). View-based active appearance models. Image Vision Comput., 20(9-10), 657 – 664. Goodall, C. (1991). Procrustes methods in the statistical analysis of shape. Journal of the Royal Statistical Society. Series B (Methodological), 53(2), 285–339. Gu, L. & Kanade, T. (2006). 3d alignment of face in a single image. In IEEE Conference on Computer Vision and Pattern Recognition. Liao, W.-K., Fidaleo, D., & Medioni, G. (2007). Integrating multiple visual cues for robust real-time 3d face tracking. In IEEE InternationalWorkshop on Analysis and Modeling of Faces and Gestures. Lu, X. & Jain, A. K. (2008). Deformation modeling for robust 3d face matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(8), 1377–1383. Munoz, E., Buenaposada, J. M., & Baumela, L. (2009). A direct approach for efficiently tracking with 3d morphable models. In IEEE International Conference on Computer Vision. Nichau, M. & Blanz, V. (2010). Pose-insensitive nose detection in tof-scans. Computer Vision and Image Understanding, 114(12), 1346 – 1352. Schneider, D. C. & Eisert, P. (2009). Fast nonrigid mesh registration with a data-driven deformation prior. In IEEE Internaltional Conference on Computer Vision Workshop on Non- Rigid Shape Analysis and Deformable image Alignment. Sung, J., Kanade, T., & Kim, D. (2008). Pose robust face tracking by combining active appearance models and cylinder head models. International Journal of Computer Vision, 80(2), 260–274. Xiao, J., Baker, S., Matthews, I., & Kanade, T. (2004). Real-time combined 2d+3d active appearance models. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Zhang, L., Snavely, N., Curless, B., & Seitz, S. M. (2004). Spacetime faces: High-resolution capture for modeling and animation. In ACM Annual Conference on Computer Graphics. Zhu, J.,Wang, L., Gao, J., &Yang, R. (2010). Spatial-temporal fusion for high accuracy depth maps using dynamic mrfs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 899–909. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/48356 | - |
dc.description.abstract | 基於外觀(appearance)的三維形變模型(Deformable model)能夠透過觀察到的外觀以及利用形變處理臉部特徵的定位。然而,當人臉於偏航角(yaw angle)左右擺動時,於二維影像上能見的臉部特徵會大量減少,使得演算法難以從臉部特徵的外觀獲取資訊,因此,傳統的方法在面臨大偏航角的臉部特徵定位是有困難的。
由於外觀的能用資訊的減少,我們引入三維點雲(3D point cloud)資訊使得臉部特徵定位獲取更多額外的訊息。利用三維點雲的資訊,我們可以得到足夠的三維結構並且更精準的估測人臉的角度,然而,三維點雲卻缺少詳細的人臉特徵輪廓的資訊。在此篇論文中,我們使用了三維點雲定位(3D point cloud matching)做三維空間的臉部定位與模型的形變,並且利用傳統二維特徵定位的訊息做為搜尋空間與形變的限制,同時,將此演算法與三維主動外觀模形結合(3D Active Appearance Model)以獲得更好的結果。為了有效運用兩種資料,我們同時也估測了二維限制以及三維形變的可信度,因此,我們可以獲取臉部的三維結構等額外訊息並利用分析資訊的可信度以增加臉部特徵定位的成功率以及更精確的角度估測,最後應用此結果重建出人臉的立體結構。 以下簡單描述我們的演算法:首先,三維主動外觀模型會先由使用者所標記的資料中學習模型的基底。接著,當相機回傳二維影像和三維點雲資訊時,基於二維外觀的特徵定位演算法會先透過模型基底的線性組合以形變模型做為二維空間形變的限制,接著,我們會藉由三維基底模型的形變去定位三維點雲的結構,而二維外觀特徵定位的結果會做為三維模型結構於影像平面上投影的限制,此限制強迫三維結構定位的投影結果必須滿足二維的定位結果。同時,二維限制的可信度以及三維點雲資訊的可信度會被計算,用以保證演算法的結果能同時滿足二維和三維的定位,此二階段的演算法會重複直到二維和三維的定位結果都已經收斂。由於此演算法的流程會利用外觀和三維點雲的結構主動調整三維外觀模型,在演算法收斂時,二維的臉部特徵定位、人臉的角度估測和三維立體結構皆可以從形變模型的結果獲得。 | zh_TW |
dc.description.abstract | Method using 3DAAM have advantages in handling face deformation and alignment. However, they tend to fail when human head is under wide yaw angles, due to the dramatic reduction of the visible facial features, which decreases the information useable by the alignment. As for 3D data alignment, due to the property of the 3D data which provides 3D structure, the alignment is able to capture the 3D structure and angle but loses the precise location of features. 3D and appearance based alignment suffers from different issues and is reliable in different situations. For dealing with wide yaw angle face alignment under the consideration of locating the features, and angle estimation, we introduce an approach to estimate the belief between 3D and 2D alignment. The algorithm incorporate 3D data alignment into 3D Active Appearance Model (3D AAM) fitting using a Time-of-Flight camera and a RGB camera. The proposed algorithm benefits from both 3D structure and texture information by estimating the belief between 3D and 2D alignment, and results in a more stable alignment with 126% improvement maximally, compared with the 3D AAM using 2D image only. Experiments demonstrate the improvement using real-world data. Its application to 3D structure recovery is also demonstrated. | en |
dc.description.provenance | Made available in DSpace on 2021-06-15T06:53:43Z (GMT). No. of bitstreams: 1 ntu-100-R98944004-1.pdf: 1354633 bytes, checksum: 363cc76d42642000fe967a756d82179e (MD5) Previous issue date: 2011 | en |
dc.description.tableofcontents | ABSTRACT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ii
LIST OF FIGURES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv LIST OF TABLES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vi CHAPTER 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 CHAPTER 2. RelatedWork . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 CHAPTER 3. 3D Active Appearance Model . . . . . . . . . . . . . . . . . . . . . . . 8 3.1. The 3D Shape Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 3.2. The Appearance Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 3.3. 3D Shape on 2D Image . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 3.4. Warp Function . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 3.5. Fitting a 3D AAM to an Image . . . . . . . . . . . . . . . . . . . . . . . . . . 11 CHAPTER 4. 3D Data Alignment in 3D AAM . . . . . . . . . . . . . . . . . . . . . . 13 4.1. 3D Data Alignment with 2D Constraint . . . . . . . . . . . . . . . . . . . . . 14 4.2. Two Stage optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 CHAPTER 5. Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 5.1. Camera System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 5.2. Data collection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 5.3. Software and Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 5.4. Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 5.4.1. Belief Estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 5.4.2. Effects of initial angle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 5.4.3. Computational Complexity . . . . . . . . . . . . . . . . . . . . . . . . . . 32 CHAPTER 6. 3D Structure Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 6.1. 3D Structure Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 CHAPTER 7. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 BIBLIOGRAPHY . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 | |
dc.language.iso | en | |
dc.title | 基於三維主動外觀模型以二維及三維影像定位大偏行角變化下之人臉特徵 | zh_TW |
dc.title | 3D AAM based Face Alignment under Yaw Angle Variation using 2D and 3D data | en |
dc.type | Thesis | |
dc.date.schoolyear | 99-1 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 洪一平,歐陽明,莊永裕 | |
dc.subject.keyword | 三維主動外觀模型,人臉特徵定位, | zh_TW |
dc.subject.keyword | 3D Active Appearance Model,Face Alignment, | en |
dc.relation.page | 38 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2011-02-11 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 資訊網路與多媒體研究所 | zh_TW |
顯示於系所單位: | 資訊網路與多媒體研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-100-1.pdf 目前未授權公開取用 | 1.32 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。