請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/42725完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 陳炳宇(Bing-Yu Chen) | |
| dc.contributor.author | Yu Liang | en |
| dc.contributor.author | 梁彧 | zh_TW |
| dc.date.accessioned | 2021-06-15T01:21:00Z | - |
| dc.date.available | 2009-08-04 | |
| dc.date.copyright | 2009-08-04 | |
| dc.date.issued | 2009 | |
| dc.date.submitted | 2009-07-24 | |
| dc.identifier.citation | [1] Aseem Agarwala, Mira Dontcheva, Maneesh Agrawala, Steven Drucker, Alex Col-
burn, Brian Curless, David Salesin, and Michael Cohen. Interactive digital pho- tomontage. In SIGGRAPH ’04: ACM SIGGRAPH 2004 Papers, pages 294–302, New York, NY, USA, 2004. ACM. [2] Shai Avidan and Ariel Shamir. Seam carving for content-aware image resizing. ACM Transactions on Graphics, Proceedings SIGGRAPH 2007, 26(3), 2007. [3] Thaddeus Beier and Shawn Neely. Feature-based image metamorphosis. SIG- GRAPH Comput. Graph., 26(2):35–42, 1992. [4] Dmitri Bitouk, Neeraj Kumar, Samreen Dhillon, Peter Belhumeur, and Shree K. Nayar. Face swapping: automatically replacing faces in photographs. In SIGGRAPH ’08: ACM SIGGRAPH 2008 papers, pages 1–8, New York, NY, USA, 2008. ACM. [5] Volker Blanz, Curzio Basso, Thomas Vetter, and Tomaso Poggio. Reanimating faces in images and video. In Pere Brunet and Dieter W. Fellner, editors, EUROGRAPH- ICS 2003 (EUROGRAPHICS-3) : the European Association for Computer Graph- ics, 24th Annual Conference, volume 22 of Computer Graphics Forum, pages 641– 650, Granada, Spain, 2003. The Eurographics Association, Blackwell. [6] Volker Blanz, Kristina Scherbaum, Thomas Vetter, and Hans-Peter Seidel. Exchang- ing faces in images. Computer Graphics Forum, 23(3):669–676, 2004. [7] Volker Blanz and Thomas Vetter. A morphable model for the synthesis of 3d faces. In SIGGRAPH ’99: Proceedings of the 26th annual conference on Computer graph- ics and interactive techniques, pages 187–194, New York, NY, USA, 1999. ACM Press/Addison-Wesley Publishing Co. [8] Cootes, Taylor, T. F. Cootes, and C. J. Taylor. A mixture model for representing shape variation. In Image and Vision Computing, pages 110–119. BMVA Press, 1997. 39 [9] T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape models—their training and application. Comput. Vis. Image Underst., 61(1):38–59, 1995. [10] T. F. Cootes, K. Walker, and C. J. Taylor. View-based active appearance models. In FG ’00: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, page 227, Washington, DC, USA, 2000. IEEE Computer Society. [11] Timothy F. Cootes, Gareth J. Edwards, and Christopher J. Taylor. Active appear- ance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6):681–685, 2001. [12] Navneet Dalal and Bill Triggs. Histograms of oriented gradients for human detec- tion. In CVPR, pages 886–893, 2005. [13] Zeev Farbman, Gil Hoffer, Yaron Lipman, Daniel Cohen-Or, and Dani Lischinski. Coordinates for instant image cloning. SIGGRAPH ’09: ACM SIGGRAPH 2009 Papers, 2009. [14] Mark Helfrich. Good luck chuck, 2007. [15] Xinwen Hou, Stan Z. Li, Hongjiang Zhang, and QianSheng Cheng. Direct appear- ance models. In Computer Vision and Pattern Recognition, pages 828–833. [16] Jiaya Jia, Jian Sun, Chi-Keung Tang, and Heung-Yeung Shum. Drag-and-drop past- ing. In SIGGRAPH ’06: ACM SIGGRAPH 2006 Papers, pages 631–637, New York, NY, USA, 2006. ACM. [17] Vivek Kwatra, Arno Sch ̈ dl, Irfan Essa, Greg Turk, and Aaron Bobick. Graphcut o textures: Image and video synthesis using graph cuts. ACM Transactions on Graph- ics, SIGGRAPH 2003, 22(3):277–286, July 2003. [18] Anat Levin, Assaf Zomet, Shmuel Peleg, and Yair Weiss. Seamless image stitching in the gradient domain. In Eighth European Conference on Computer Vision (ECCV 2004), pages 377–389. Springer-Verlag, 2003. [19] Lin Liang, Fang Wen, Ying-Qing Xu, Xiaoou Tang, and Heung-Yeung Shum. Accu- rate face alignment using shape constrained markov network. Computer Vision and Pattern Recognition, IEEE Computer Society Conference on, 1:1313–1319, 2006. [20] Lin Liang, Rong Xiao, Fang Wen, and Jian Sun. Face alignment via component- based discriminative search. In ECCV ’08: Proceedings of the 10th European 40 Conference on Computer Vision, pages 72–85, Berlin, Heidelberg, 2008. Springer- Verlag. [21] Ce Liu, Heung yeung Shum, and Changshui Zhang. Hierarchical shape modeling for automatic face localization. In Proc. European Conference on Computer Vision, pages 687–703, 2002. [22] Xiaoming Liu. Generic face alignment using boosted appearance model. In Proc. IEEE Computer Vision and Pattern Recognition, pages 1079–1088, 2007. [23] Zicheng Liu, Ying Shan, and Zhengyou Zhang. Expressive expression mapping with ratio images. In SIGGRAPH ’01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 271–276, New York, NY, USA, 2001. ACM. [24] A.M. Martinez and R. Benavente. The ar face database, June 1998. [25] S. Milborrow and F. Nicolls. Locating facial features with an extended active shape model. ECCV, 2008. http://www.milbo.users.sonic.net/stasm. [26] P. P ́ rez, M. Gangnet, and A. Blake. Poisson image editing. ACM Transactions on e Graphics (SIGGRAPH’03), 22(3):313–318, 2003. [27] Donald Petrie. Just my luck, 2006. [28] P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss. The feret evaluation method- ology for face recognition algorithms. IEEE Trans. Pattern Analysis and Machine Intelligence, 22:1090–1104, 2000. [29] P.J. Phillips, H. Wechsler, J. Huang, and P. Rauss. The feret database and evalu- ation procedure for face recognition algorithms. Image and Vision Computing J, 16(5):295–306, 1998. [30] Sami Romdhani, Shaogang Gong, Alexandra Psarrou, and Ra Psarrou. A multi- view nonlinear active shape model using kernel pca. In British Machine Vision Conference, pages 483–492. BMVA Press, 1999. [31] Michael E. Tipping, Cambridge Cb Nh, and Christopher M. Bishop. Mixtures of probabilistic principal component analysers, 1998. [32] C. Tomasi and R. Manduchi. Bilateral filtering for gray and color images. In ICCV ’98: Proceedings of the Sixth International Conference on Computer Vision, page 839, Washington, DC, USA, 1998. IEEE Computer Society. 41 [33] Jilin Tu, Zhenqiu Zhang, Zhihong Zeng, and Thomas Huang. Face localization via hierarchical condensation with fisher boosting feature selection. Computer Vision and Pattern Recognition, IEEE Computer Society Conference on, 2:719–724, 2004. [34] Hongcheng Wang, Ramesh Raskar, and Narendra Ahuja. Seamless video editing. Pattern Recognition, International Conference on, 3:858–861, 2004. [35] Hongcheng Wang, Ning Xu, Ramesh Raskar, and Narendra Ahuja. Videoshop: A new framework for spatio-temporal video editing in gradient domain. In CVPR ’05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) - Volume 2, page 1201, Washington, DC, USA, 2005. IEEE Computer Society. [36] Joe H. Ward. Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association, 58(301):236–244, 1963. [37] Yi Zhou, Lie Gu, and Hong-Jiang Zhang. Bayesian tangent shape model: Estimat- ing shape and pose parameters via bayesian inference. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2003. | |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/42725 | - |
| dc.description.abstract | 在本論文中,我們提出一個完整的系統來實作影片中的人臉置換功
能。我們的系統會接受兩個輸入影片,主要目的是把其中一個影片裡 角色的人臉置換成另一個影片中的人臉。我們的系統分成三個主要的 步驟,首先我們會找出影片中的人臉位置,而且在找到的人臉上標出 主要的臉部特徵,其次是分析影片中人臉的表情和角度方位並且選出 最適當的替換表情,最後我們把選到的替換表情貼上並且把顏色做適 當的混成。我們的系統不需要任何3D的模型資訊,是全自動並且可以 產生逼真的效果。 | zh_TW |
| dc.description.abstract | In this paper, we present a complete system for plausible face replacement
of videos. In our system, we take two videos as inputs. And we aim to replace the target human subject’s face with another human subject’s in the other video. Our replacement algorithm has three main stages. First, given an input video, we detect all faces that are present, and align such detected faces. Second, we analyze facial expressions of each detected faces and select candidate face images from source video that are most similar to the target face in pose and expression. Third, we blend candidate replacements to target video. Our approach requires no 3D model, is fully automatic and generates plausible results. | en |
| dc.description.provenance | Made available in DSpace on 2021-06-15T01:21:00Z (GMT). No. of bitstreams: 1 ntu-98-R96922034-1.pdf: 10092057 bytes, checksum: f0008f57a3754422152a14fd549e2584 (MD5) Previous issue date: 2009 | en |
| dc.description.tableofcontents | 口試委員會審定書 i
中文摘要 iii Abstract v 1 Introduction 1 1.1 System Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 1.2 Chapter Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 2 Related Work 5 2.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2.2 Face Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2.3 Face Alignment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 2.4 Blending . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 3 Face Alignment 9 3.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 3.2 Bayesian formulation to Shape Registration . . . . . . . . . . . . . . . . 9 3.2.1 Problem Formulation . . . . . . . . . . . . . . . . . . . . . . . . 9 3.2.2 Prior Model in BTSM . . . . . . . . . . . . . . . . . . . . . . . 10 3.2.3 Likelihood Model in BTSM . . . . . . . . . . . . . . . . . . . . 11 3.2.4 Posterior in BTSM . . . . . . . . . . . . . . . . . . . . . . . . . 11 3.3 EM Based Parameter Estimation in BTSM . . . . . . . . . . . . . . . . . 12 3.3.1 Expectation Step . . . . . . . . . . . . . . . . . . . . . . . . . . 12 3.3.2 Maximization Step . . . . . . . . . . . . . . . . . . . . . . . . . 13 3.4 Extensions to the BTSM . . . . . . . . . . . . . . . . . . . . . . . . . . 13 3.4.1 2D Profiles . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 3.4.2 Adding Virtual Shapes . . . . . . . . . . . . . . . . . . . . . . . 14 3.5 Experiment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 3.6 Face Alignment in Video . . . . . . . . . . . . . . . . . . . . . . . . . . 15 3.6.1 Bilateral Filtering . . . . . . . . . . . . . . . . . . . . . . . . . . 15 4 Temporal Segmentation And Shape Based Selection 19 4.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 4.2 Clustering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 4.2.1 Hierarchical Clustering . . . . . . . . . . . . . . . . . . . . . . . 20 4.2.2 Mahalanobis Distance Metric . . . . . . . . . . . . . . . . . . . 20 4.2.3 Dendrogram . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 vii 4.2.4 Number of Clusters . . . . . . . . . . . . . . . . . . . . . . . . . 22 4.3 Shape Based Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 4.3.1 Difference Vector . . . . . . . . . . . . . . . . . . . . . . . . . . 23 4.3.2 Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 4.4 Warping Expressions . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 4.4.1 Interpolation Between Clusters . . . . . . . . . . . . . . . . . . . 24 4.4.2 Warping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 5 Blending 27 5.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 5.2 Seamlessly Cloning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 5.2.1 Rationale . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 5.2.2 Mean Value Coordinate . . . . . . . . . . . . . . . . . . . . . . . 28 5.2.3 Face Concealment . . . . . . . . . . . . . . . . . . . . . . . . . 29 5.2.4 Replacement Region . . . . . . . . . . . . . . . . . . . . . . . . 30 5.2.5 Boundary Selection . . . . . . . . . . . . . . . . . . . . . . . . . 31 5.2.6 Mean Value Video Cloning . . . . . . . . . . . . . . . . . . . . . 33 6 Conclusion 35 Bibliography 39 | |
| dc.language.iso | en | |
| dc.subject | 計算攝影學 | zh_TW |
| dc.subject | 人臉置換 | zh_TW |
| dc.subject | 影像繪圖 | zh_TW |
| dc.subject | Face Replacement | en |
| dc.subject | Computational Photography | en |
| dc.subject | Image-Based Rendering | en |
| dc.title | 以影像處理為基礎的影片中人臉置換系統 | zh_TW |
| dc.title | Image Based Face Replacement in Video | en |
| dc.type | Thesis | |
| dc.date.schoolyear | 97-2 | |
| dc.description.degree | 碩士 | |
| dc.contributor.oralexamcommittee | 莊永裕(Yung-Yu Chuang),歐陽明(Ming Ouhyoung),楊傳凱(Chuan-Kai Yang),林奕成(I-Chen Lin) | |
| dc.subject.keyword | 人臉置換,影像繪圖,計算攝影學, | zh_TW |
| dc.subject.keyword | Face Replacement,Image-Based Rendering,Computational Photography, | en |
| dc.relation.page | 42 | |
| dc.rights.note | 有償授權 | |
| dc.date.accepted | 2009-07-27 | |
| dc.contributor.author-college | 電機資訊學院 | zh_TW |
| dc.contributor.author-dept | 資訊工程學研究所 | zh_TW |
| 顯示於系所單位： | 資訊工程學系 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| ntu-98-1.pdf 未授權公開取用 | 9.86 MB | Adobe PDF |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。