請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/42630完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 莊永裕 | |
| dc.contributor.author | Yi-Ting Cheng | en |
| dc.contributor.author | 鄭逸廷 | zh_TW |
| dc.date.accessioned | 2021-06-15T01:18:11Z | - |
| dc.date.available | 2009-08-03 | |
| dc.date.copyright | 2009-08-03 | |
| dc.date.issued | 2009 | |
| dc.date.submitted | 2009-07-27 | |
| dc.identifier.citation | [1] The prestige, 2006.
[2] Good luck chuck, 2007. [3] GNU Scientific Library Reference Manual - Third Edition. Network Theory Ltd., 2009. [4] T. Akimoto, Y. Suenaga, and R. S.Wallace. Automatic creation of 3d facial models. IEEE Computer Graphics and Applications, 13(5):16–22, 1993. [5] D. Bitouk, N. Kumar, S. Dhillon, P. N. Belhumeur, and S. K. Nayar. Face swapping: automatically replacing faces in photographs. ACM Transactions on Graphics (SIGGRAPH), 27(3), 2008. [6] V. Blanz, C. Basso, T. Poggio, and T. Vetter. Reanimating faces in images and video. Computer Graphics Forum, 22:641–650, 2003. [7] V. Blanz, K. Scherbaum, T. Vetter, and H.-P. Seidel. Exchanging faces in images. Computer Graphics Forum, 23(3):669–676, 2004. [8] V. Blanz and T. Vetter. A morphable model for the synthesis of 3d faces. In Computer Graphics Proc. SIGGRAPH’99, pages 187–194, 1999. [9] V. Blanz and T. Vetter. Face recognition based on fitting a 3d morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9):1063–1074, 2003. [10] P. Breuer, K. I. Kim, W. Kienzle, B. Sch¨olkopf, and V. Blanz. Automatic 3d face reconstruction from single images or video. In IEEE International Conference on Automatic Face and Gesture Recognition, pages 1–8, 2008. [11] Z. Farbman, G. Hoffer, Y. Lipman, D. Cohen-Or, and D. Lischinski. Coordinates for instant image cloning. ACM Transactions on Graphics (SIGGRAPH), 2009. [12] B. Fasel and J. Luettin. Automatic facial expression analysis: A survey. Pattern Recognition, 36(1):259–275, 2003. [13] M. Fuchs, H. Lensch, and H.-P. Seidel. Reflectance from images: A model-based approach for human faces. IEEE Transactions on Visualization and Computer Graphics, 11(3):296–305, 2005. Member-Blanz, Volker. [14] M. R. Hestenes and E. Stiefel. Methods of conjugate gradients for solving linear systems. Journal of Research of the National Bureau of Standards, 49:409–436, 1952. [15] C.-J. Hu. A real-time skin-color-enhanced face detection algorithm, 2007. [16] J. Jia, J. Sun, C.-K. Tang, and H.-Y. Shum. Drag-and-drop pasting. ACM Transactions on Graphics (SIGGRAPH), 2006. [17] Y. Liang. Image based face replacement in video. Master’s thesis, CSIE Department, National Taiwan University, 2009. [18] Z. Liu, Z. Zhang, C. Jacobs, and M. Cohen. Rapid modeling of animated faces from video images. In Proceedings of ACM International Conference on Multimedia, pages 475–476, 2000. [19] J. A. Nelder and R. Mead. A simplex method for function minimization. Computer Journal, 7:308–313, 1965. [20] P. P´erez, M. Gangnet, and A. Blake. Poisson image editing. ACM Transactions on Graphics (SIGGRAPH), 22:313–318, 2003. [21] F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. H. Salesin. Synthesizing realistic facial expressions from photographs. In SIGGRAPH ’06: ACM SIGGRAPH 2006 Courses, page 19, 2006. [22] H. Pyun, Y. Kim,W. Chae, H.W. Kang, and S. Y. Shin. An example-based approach for facial expression cloning. In 2003 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, pages 167–176, 2003. [23] G. Sannier and N. Magnenat-Thalmann. A user-friendly texture-fitting methodology for virtual humans. In CGI ’97: Proceedings of the 1997 Conference on Computer Graphics International, page 167, 1997. [24] C.-H. Tseng. Pose and lighting estimation for face replacement in video. Master’s thesis, CSIE Department, National Taiwan University, 2009. [25] T. Vetter and V. Blanz. Estimating coloured 3d face models from single images: An example based approach. In Proceedings of the 5th European Conference on Computer Vision-Volume II, pages 499–513, 1998. [26] H. Wang, R. Raskar, and N. Ahuja. Seamless video editing. In ICPR 2004: Proceedings of the Pattern Recognition, 17th International Conference on (ICPR’04) Volume 3, pages 858–861, 2004. [27] J. yong Noh and U. Neumann. Expression cloning. In SIGGRAPH ’06: ACM SIGGRAPH 2006 Courses, page 22, 2006. | |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/42630 | - |
| dc.description.abstract | 本論文提出了一個以三維形變模型(3D morphable model)為基礎
之視訊中人臉置換(face replacement)系統。此系統將來源人物(source subject)在與目標人物(target subject)相似之角度、表情以及光照條件下 置換入目標影片中。視訊中人臉置換系統在特效產業以及娛樂產業中 極為有用，過去雖然有許多影像中人臉置換演算法被提出， 也有許多 現有軟體存在，然而應用到影片中仍然需要耗費大量的人力和時間。 本論文提出之人臉置換系統可大幅減少所需人力介入的需求，並且將 來源人物所需擷取資料量減少至只需一至兩張照片。此系統共有八個 主要模組，包括：人臉校準、方位估計、人臉擷取、三維人臉模型生 成、表情估計及生成、打光估計及人臉重打光、人臉影像生成、視訊 中影像合成。在這篇論文中，我們主要探討的主題是三維人臉模型生 成、表情估計及生成以及視訊中影像合成技術。為證實我們演算法的 有效性，我們將對電影中擷取之影像以及我們實際拍攝的影像進行測 試， 並且將結果完整呈現在論文之中。 | zh_TW |
| dc.description.abstract | This thesis presents a system that replaces the target subject face in the
target video with the source subject face, under similar pose, expression, and illumination. Face replacement in video is a useful application in the entertainment and special effect industries. However, the frame-by-frame manipulation process using the software is often time-consuming and labor-intensive. Our approach is based on 3D morphable model and a expression database, and the input information of the source subject face is reduced to one to two images, while the face replacement procedure requires little user interference. Our system consists of several modules: face alignment, pose estimation, expression estimation, face extraction, morphable model fitting, face synthesis, face relighting, and composition. We mainly focus on morphable model fitting, expression estimation, and composition in this thesis. To demonstrate the effectiveness of our system, we test our implementation on both movie clips and video we captured. | en |
| dc.description.provenance | Made available in DSpace on 2021-06-15T01:18:11Z (GMT). No. of bitstreams: 1 ntu-98-R96922015-1.pdf: 28203241 bytes, checksum: 4961493fe4b7bab93fdc8fb4140231b3 (MD5) Previous issue date: 2009 | en |
| dc.description.tableofcontents | 致謝i
中文摘要iii Abstract v 1 Introduction 1 1.1 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 Problem Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.3 Thesis Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 2 Related Work 5 2.1 Image-Based Modeling . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2.2 Expression Manipulation . . . . . . . . . . . . . . . . . . . . . . . . . . 6 2.3 Face Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 2.4 Seamless Image Composition . . . . . . . . . . . . . . . . . . . . . . . . 8 3 System Overview 9 4 3D Face Reconstruction 13 4.1 Database . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 4.2 Morphable 3D Face Model . . . . . . . . . . . . . . . . . . . . . . . . . 17 4.3 Matching A Morphable Model to Images . . . . . . . . . . . . . . . . . 18 4.3.1 Image Synthesis . . . . . . . . . . . . . . . . . . . . . . . . . . 20 4.3.2 Fitting the Model to Images . . . . . . . . . . . . . . . . . . . . 20 4.4 Model Reconstruction Result . . . . . . . . . . . . . . . . . . . . . . . . 25 5 Matching Expression and Composition 29 5.1 Expression Cloning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 5.1.1 3D Model Expression Database . . . . . . . . . . . . . . . . . . 30 5.1.2 Matching Correspondence . . . . . . . . . . . . . . . . . . . . . 31 5.1.3 Cloning Expression . . . . . . . . . . . . . . . . . . . . . . . . . 32 5.2 Matching Expressions to Target Video . . . . . . . . . . . . . . . . . . . 34 5.2.1 Matching the Mouth . . . . . . . . . . . . . . . . . . . . . . . . 36 5.2.2 Matching the Blinking . . . . . . . . . . . . . . . . . . . . . . . 39 5.3 Composition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 5.3.1 Poisson Image Editing . . . . . . . . . . . . . . . . . . . . . . . 42 5.3.2 Face Concealment . . . . . . . . . . . . . . . . . . . . . . . . . 43 5.3.3 Blending . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 6 Experiments and Results 45 6.1 Face Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45 7 Conclusion and Discussion 51 Bibliography 53 | |
| dc.language.iso | en | |
| dc.subject | 人臉置換 | zh_TW |
| dc.subject | 計算攝影學 | zh_TW |
| dc.subject | Face Replacement | en |
| dc.subject | Computational Photography | en |
| dc.title | 以三維形變模型為基礎之視訊中人臉置換 | zh_TW |
| dc.title | 3D Morphable Model Based Face Replacement in Video | en |
| dc.type | Thesis | |
| dc.date.schoolyear | 97-2 | |
| dc.description.degree | 碩士 | |
| dc.contributor.oralexamcommittee | 歐陽明,楊傳凱,林奕成,王傑智 | |
| dc.subject.keyword | 人臉置換,計算攝影學, | zh_TW |
| dc.subject.keyword | Face Replacement,Computational Photography, | en |
| dc.relation.page | 55 | |
| dc.rights.note | 有償授權 | |
| dc.date.accepted | 2009-07-27 | |
| dc.contributor.author-college | 電機資訊學院 | zh_TW |
| dc.contributor.author-dept | 資訊工程學研究所 | zh_TW |
| 顯示於系所單位： | 資訊工程學系 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| ntu-98-1.pdf 未授權公開取用 | 27.54 MB | Adobe PDF |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。