請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/10141
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 歐陽明(Ming Ouhyoung) | |
dc.contributor.author | Shih-Hao Hsiung | en |
dc.contributor.author | 熊士豪 | zh_TW |
dc.date.accessioned | 2021-05-20T21:04:59Z | - |
dc.date.available | 2011-07-18 | |
dc.date.available | 2021-05-20T21:04:59Z | - |
dc.date.copyright | 2011-07-18 | |
dc.date.issued | 2011 | |
dc.date.submitted | 2011-07-06 | |
dc.identifier.citation | [1] R. Basri and D.W. Jacobs. Lambertian reflectance and linear subspaces. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 25(2):218 – 233, feb 2003.
[2] Soma Biswas, Gaurav Aggarwal, and Rama Chellappa. Robust estimation of albedo for illumination-invariant matching and shape recovery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31:884–899, 2009. [3] D. Bitouk, N. Kumar, S. Dhillon, P. N. Belhumeur, and S. K. Nayar. Face Swapping: Automatically Replacing Faces in Photographs. ACM Trans. on Graphics (also Proc. of ACM SIGGRAPH), Aug 2008. [4] Volker Blanz, Curzio Basso, Thomas Vetter, and Tomaso Poggio. Reanimating faces in images and video. In Pere Brunet and Dieter W. Fellner, editors, EUROGRAPHICS 2003 (EUROGRAPHICS-03) : the European Association for Computer Graphics, 24th Annual Conference, volume 22 of Computer Graphics Forum, pages 641–650, Granada, Spain, 2003. The Eurographics Association, Blackwell. [5] Volker Blanz, Kristina Scherbaum, Thomas Vetter, and Hans-Peter Seidel. Exchanging faces in images. In Marie-Paule Cani and Mel Slater, editors, The European Association for Computer Graphics 25th Annual Conference EUROGRAPHICS 2004, volume 23 of Computer Graphics Forum, pages 669–676, Grenoble, France, 2004. Blackwell. [6] Volker Blanz and Thomas Vetter. A morphable model for the synthesis of 3d faces. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques, SIGGRAPH ’99, pages 187–194, New York, NY, USA, 1999. ACM Press/Addison-Wesley Publishing Co. [7] Q. Chen, H. Wu, T. Fukumoto, and M. Yachida. 3d head pose estimation without feature tracking. In Proceedings of the 3rd. International Conference on Face & Gesture Recognition, FG ’98, pages 88–, Washington, DC, USA, 1998. IEEE Computer Society. [8] Yi-Ting Cheng, Virginia Tzeng, Yu Liang, Chuan-Chang Wang, Bing-Yu Chen, Yung-Yu Chuang, and Ming Ouhyoung. 3d-model-based face replacement in video. In SIGGRAPH ’09: Posters, SIGGRAPH ’09, pages 29:1–29:1, New York, NY, USA, 2009. ACM. [9] Yung-Yu Chuang, Brian Curless, David H. Salesin, and Richard Szeliski. A bayesian approach to digital matting. In Proceedings of IEEE CVPR 2001, volume 2, pages 264–271. IEEE Computer Society, December 2001. [10] Paul Fitzpatrick. Head pose estimation without manual initialization. 2007. [11] Jiaya Jia, Jian Sun, Chi-Keung Tang, and Heung-Yeung Shum. Drag-and-drop pasting. ACM Transactions on Graphics (SIGGRAPH), 2006. [12] Ritwik Kumar, Michael Jones, and Tim K. Marks. Morphable reflectance fields for enhancing face recgonition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010. [13] Vivek Kwatra, Arno Sch‥odl, Irfan Essa, Greg Turk, and Aaron Bobick. Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph., 22:277–286, July 2003. [14] T.M. Mahmoud. A new fast skin color detection technique. In Processing of World Academy of Science, Engineering And Technology Volume 33 ISSN p.2070-3740, volume 2, pages 525 –528, march 2010. [15] Patrick P′erez, Michel Gangnet, and Andrew Blake. Poisson image editing. In ACM SIGGRAPH 2003 Papers, SIGGRAPH ’03, pages 313–318, New York, NY, USA, 2003. ACM. [16] T. Vatahska, M. Bennewitz, and S. Behnke. Feature-based head pose estimation from images. In Proc. of the IEEE-RAS International Conference on Humanoid Robots (Humanoids), 2007. [17] Yang Wang, Zicheng Liu, Gang Hua, Zhen Wen, Zhengyou Zhang, and Dimitris Samaras. Face re-lighting from a single image under harsh lighting conditions. In CVPR’07, pages –1–1, 2007. [18] ZhenWen, Zicheng Liu, and T.S. Huang. Face relighting with radiance environment maps. In Computer Vision and Pattern Recognition, 2003. Proceedings. 2003 IEEE Computer Society Conference on, volume 2, pages II – 158–65 vol.2, june 2003. [19] Miroslav Hamouz Xuan Zou, Josef Kittler and Jose R. Tena. Robust albedo estimation from face image under unknown illumination. In Proc. SPIE 6944, 69440A, page doi:10.1117/12.778599, 2008. [20] Yi Zhou, Lie Gu, and Hong-Jiang Zhang. Bayesian tangent shape model: Estimating shape and pose parameters via bayesian inference. In Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition, CVPR’03, pages 109–116, Washington, DC, USA, 2003. IEEE Computer Society. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/10141 | - |
dc.description.abstract | 在本論文中,我們提出了一套在任意光照環境下,模擬出人臉陰影(self-shadow)及環境光遮擋(ambient occlusion)的人臉置換系統。藉由結合陰影圖(shadow map)和重新打光(relighting)的臉部影像,我們重新模擬出類似目標人臉的光影情況。並且使用無接縫影像結合演算法(Drag-and-Drop Pasting)找出最佳接縫邊緣,以維持較好的臉部特徵結果。最後,我們在混合兩張人臉時,採用影像強度梯度的混合(mixing gradients)去保存表情細節,使得最後結果與目標人臉的表情
更加一致也更加生動。 | zh_TW |
dc.description.abstract | In this thesis, we present a face replacement system, which can simulate the harsh lighting condition such as self-shadow and ambient-occlusion in the target image. First, we use Drag-and-Drop pasting to better maintain the facial saliency with optimal composition boundary. Then we incorporate the mixing gradient method in the blending process to preserve the vivid expression details. In the last step, we propose a method that combines the relighting source image and a shadow map to simulate the self-shadow condition in the target face. | en |
dc.description.provenance | Made available in DSpace on 2021-05-20T21:04:59Z (GMT). No. of bitstreams: 1 ntu-100-R98922161-1.pdf: 8370914 bytes, checksum: 95bf2bf6c7c2c86b5748a0db96f8ff5b (MD5) Previous issue date: 2011 | en |
dc.description.tableofcontents | 致謝i
中文摘要iii Abstract v 1 Introduction 1 1.1 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 System Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 1.3 Thesis Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 2 Related Work 5 2.1 Face Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2.2 Pose Estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 2.3 Relighting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 2.4 Seamless Composition . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 3 Pose Estimation 9 3.1 Estimate pose . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 3.2 Overlapping Region . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 3.3 Result . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 4 Lighting Estimation 17 4.1 Spherical Harmonics Relight . . . . . . . . . . . . . . . . . . . . . . . . 19 4.2 Robust Albedo Relighting . . . . . . . . . . . . . . . . . . . . . . . . . 22 4.3 Self-Shadow in Face Image . . . . . . . . . . . . . . . . . . . . . . . . . 24 4.4 Result . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 5 Face Composition 31 5.1 Poisson Image Editing . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 5.2 Optimizing Blending Boundary . . . . . . . . . . . . . . . . . . . . . . . 33 5.3 Target Face Geometry Recovery . . . . . . . . . . . . . . . . . . . . . . 36 5.4 Result . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 6 Result and Discussion 41 7 Conclusion and Future Work 45 7.1 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45 7.2 Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Bibliography 49 | |
dc.language.iso | en | |
dc.title | 人臉置換下臉部自身陰影及環境光遮擋的修復 | zh_TW |
dc.title | Self-Shadow and Ambient Occlusion Recovery for Face Images in Face Replacement | en |
dc.type | Thesis | |
dc.date.schoolyear | 99-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 張鈞法(Chun-Fa Chang),陳維超(Wei-Chao Chen) | |
dc.subject.keyword | 人臉置換,人臉姿勢評估,人臉重打光,陰影估計,人臉合成, | zh_TW |
dc.subject.keyword | Face Replacement,Pose Estimation,Face Relighting,Shadow Estimation,Face composition, | en |
dc.relation.page | 52 | |
dc.rights.note | 同意授權(全球公開) | |
dc.date.accepted | 2011-07-06 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 資訊工程學研究所 | zh_TW |
顯示於系所單位: | 資訊工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-100-1.pdf | 8.17 MB | Adobe PDF | 檢視/開啟 |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。