Skip navigation

DSpace

機構典藏 DSpace 系統致力於保存各式數位資料(如:文字、圖片、PDF)並使其易於取用。

點此認識 DSpace
DSpace logo
English
中文
  • 瀏覽論文
    • 校院系所
    • 出版年
    • 作者
    • 標題
    • 關鍵字
    • 指導教授
  • 搜尋 TDR
  • 授權 Q&A
    • 我的頁面
    • 接受 E-mail 通知
    • 編輯個人資料
  1. NTU Theses and Dissertations Repository
  2. 電機資訊學院
  3. 資訊工程學系
請用此 Handle URI 來引用此文件: http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/44512
完整後設資料紀錄
DC 欄位值語言
dc.contributor.advisor陳炳宇(Bing-Yu Chen)
dc.contributor.authorHsin-Yi Chenen
dc.contributor.author陳心怡zh_TW
dc.date.accessioned2021-06-15T03:02:09Z-
dc.date.available2009-08-03
dc.date.copyright2009-08-03
dc.date.issued2009
dc.date.submitted2009-07-30
dc.identifier.citation[1] H.G. Barrow and J.M. Tenenbaum. Recovering intrinsic scene characteristics from
images. Computer Vision Systems., pages 3–26, 1978.
[2] R. Basri, D. Jacobs, and I. Kemelmacher. Photometric stereo with general,unknown
lighting. International Journal of Computer Vision, pages 239–257, 2007.
[3] Hernandez C, G. Vogiatzis, and R. Cipolla. Shadows in three-source photometric
stereo. European Conference on Computer Vision, pages 290–303, 2008.
[4] M. Chandraker and S. Aqarwal ans D. Krieqman. Shadowcuts: Photometric stereo
with shadows. Computer Vision and Pattern Recognition, 2007.
[5] P. Debevec, C. Tchou, A. Gardner, T. Hawkins, C. Poullis, and J. stum. Estimating
surface reflectance properties of a complex scene under captured natural illumination.
[6] K. Hayakawa. Photometric stereo under a light source with arbitrary motion. Journal
of the Optical Society of America.
[7] D. Hoiem, A.A. Efros, and M. Hebert. Automatic photo pop-up. ACM Transactions
on Graphics [Proc. SIGGRAPH]), year = 2005, volume= 24, number= 3, pages =
577-584.
[8] C. Julia, A.D. Sappa, F. Lumbreras, J.Serrat, and A. Lopez. Recovery of surface
normals and reflectance from different lighting conditions. Proceedings of the 5th
international conference on Image Analysis and Recognition, pages 315–325, 2008.
[9] D.D. Lee and H.S. Seung. Algorithm for non-negative matrix factorization. Advanced
in Nerual Information Processing Systems, pages 556–562, 2001.
[10] C.-J. Lin. Projected gradient methods for non-negative matrix factorization. Neural
Computation, pages 2745–2779, 2007.
[11] W. Matusik, M. Loper, and H. Pfister. Progressively-refined reflectance functions
from natural illumination. Eurographics Symposium on Rendering, 2004.
[12] J. Nimeroff, E. P. Simoncelli, and J. Dorsey. Efficient re-rendering of naturally
illuminated environments. In Fifth Annual Eurographics Symposium on.
[13] E. Reinhard, M. Adhikhmin, B. Gooch, and P. Shirley. Color transfer between images.
Computer Graphics and Application, IEEE, 21:34–41, 2001.
[14] M.Petrou S. Barsky. The 4-source photometric stereo technique for threedimensionalsurfaces in the presence of highlights and shadows. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10), 2003.
[15] K. Sunkavalli, W. Matusik, H. Pfister, and S.Rusinkiewiez. Factored time-lapse
video. ACM Transactions on Graphics (Proc. SIGGRAPH), (3), 2007.
[16] L. Tao, L. Yuan, and J. Sun. Skyfinder: Attribute-based sky image search. ACM Transactions on Graphics, [Proc. SIGGRAPH], 2009.
[17] Greg Ward. Fast,robust image registration for compositing high dynamic range
photographs from hand held exposures. journal of graphics, gpu, and game tools,8(2):17–30.
[18] Y. Weiss. Deriving intrinsic images from image sequences. International Conference
on Computer Vision, 2, 2001.
[19] R.J. Woodham. Photometric method for determining surface orientation from multiple
images. Optical Engineering, 19(1):139–144, 1980.
[20] Y. Yu and J. Malik. Recovering photometric properties of architectural scenes from
photographs. ACM Transactions on Graphics,[Proc. SIGGRAPH], pages 207–218,
1998.
[21] A.L. Yullie, D. Snow, R.Epstein, and P.N. Belhumeur. Determining generative models
of objects under varying illumination : Shape and albedo from multiple image using svd and integrability. International Journal of Computer Vision, pages 203–222, 1999.
dc.identifier.urihttp://tdr.lib.ntu.edu.tw/jspui/handle/123456789/44512-
dc.description.abstract室外場景不同的光影呈現, 往往帶給觀賞的人不一樣的視覺感受.
但是在很多狀況下,我們對場景所拍攝的照片不一定能捕捉到我們想要
的光線.
在這篇論文中,我們提供了一套轉換場景光線的系統,不需要真實的物理
反射模型或事先獲得場景的3D資訊,而得以對場景中的光線進行轉換.
我們利用拍攝不同光源方向,但是同樣視角的室外場景影片,利用非負矩
陣分解, 還原出場景的法向量,可能的物理反射模型以及光源的方向和
強度. 利用求得的幾何參數和另外一組場景的光源方向和強度, 我們可
以將不同光源的特性轉換到我們想要改變光源的場景上, 合成擬真的繪
圖.
v
zh_TW
dc.description.abstractLighting makes a significant perceptual impact on visual perception,
but our photo are sometimes captured during rather bother lighting condition.
We propose a method to transfer lights from one outdoor scene to
another by using sequences of time-varying videos taken from both scenes.
Our algorithm first detect shadow area for each image. We consider pixels in
shadow as unreliable data, then using an iterative photometric stereo framework
with non-negative matrix factorization method to compute geometry
term and lighting term of the scene. The factorization result allows users to
easily relight the scene by transfer lighting from user specified lighting model
to the target image. We demonstrate via several examples that our method
generates good results and keep color consistency
en
dc.description.provenanceMade available in DSpace on 2021-06-15T03:02:09Z (GMT). No. of bitstreams: 1
ntu-98-R96922129-1.pdf: 2880836 bytes, checksum: 11ac9000d6adb01d9f1d9ce3118d46cc (MD5)
Previous issue date: 2009
en
dc.description.tableofcontents口試委員審定書
致謝
中文摘要
Abstract
1 Introduction 1
1.1 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Problem statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2 Related Work 5
2.1 Time-lapse sequence analysis . . . . . . . . . . . . . . . . . . . . . . . . 5
2.2 Photometric stereo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
2.3 Relighting of outdoor scene . . . . . . . . . . . . . . . . . . . . . . . . . 7
3 Overview 9
4 Video Processing 13
4.1 Sky Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
4.2 Frame extraction and Alignment . . . . . . . . . . . . . . . . . . . . . . 14
4.3 Lighting Clustering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5 Model Formulation 17
5.1 Lambertian Surface Model . . . . . . . . . . . . . . . . . . . . . . . . . 17
5.2 Orientation From Colour . . . . . . . . . . . . . . . . . . . . . . . . . . 18
5.2.1 Photometric Stereo Using Factorization . . . . . . . . . . . . . . 18
5.3 Matrix Factorization . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
5.3.1 Non-negative Matrix Factorization . . . . . . . . . . . . . . . . . 23
5.4 Problem Formulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
6 Algorithm 25
6.1 Shadow Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
6.2 First Factorization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
6.2.1 Surface Normal and Light Direction Estimation . . . . . . . . . . 32
6.3 Second Factorization . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
6.3.1 Surface Albedo Estimation . . . . . . . . . . . . . . . . . . . . . 34
6.3.2 Light Intensity Estimation and Normalization . . . . . . . . . . . 34
6.4 Synthesis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
6.4.1 Sky Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . 36
6.4.2 Relighting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
7 Result 37
8 Conclusion and Future work 45
8.1 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
8.2 Future work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Bibliography 47
dc.language.isoen
dc.subject計算攝影學zh_TW
dc.subject影像式描繪zh_TW
dc.subject逆向問題zh_TW
dc.subjectinverse problemen
dc.subjectimage-based renderingen
dc.subjectcomputational photographyen
dc.title時間變化影片之光線轉移使用非負矩陣分解zh_TW
dc.titleLighting Transfer via Non-negative Matrix Factorization for
Time-varying Video
en
dc.typeThesis
dc.date.schoolyear97-2
dc.description.degree碩士
dc.contributor.oralexamcommittee陳祝嵩,張鈞法
dc.subject.keyword影像式描繪,逆向問題,計算攝影學,zh_TW
dc.subject.keywordimage-based rendering,inverse problem,computational photography,en
dc.relation.page49
dc.rights.note有償授權
dc.date.accepted2009-07-30
dc.contributor.author-college電機資訊學院zh_TW
dc.contributor.author-dept資訊工程學研究所zh_TW
顯示於系所單位:資訊工程學系

文件中的檔案:
檔案 大小格式 
ntu-98-1.pdf
  未授權公開取用
2.81 MBAdobe PDF
顯示文件簡單紀錄


系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。

社群連結
聯絡資訊
10617臺北市大安區羅斯福路四段1號
No.1 Sec.4, Roosevelt Rd., Taipei, Taiwan, R.O.C. 106
Tel: (02)33662353
Email: ntuetds@ntu.edu.tw
意見箱
相關連結
館藏目錄
國內圖書館整合查詢 MetaCat
臺大學術典藏 NTU Scholars
臺大圖書館數位典藏館
本站聲明
© NTU Library All Rights Reserved