請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/63389
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 盧奕璋(Yi-Chang Lu) | |
dc.contributor.author | Che-Wei Chang | en |
dc.contributor.author | 張哲維 | zh_TW |
dc.date.accessioned | 2021-06-16T16:38:43Z | - |
dc.date.issued | 2012 | |
dc.date.submitted | 2012-09-25 | |
dc.identifier.citation | [1] E. H. Adelson and J. R. Bergen, 'The plenoptic function and the elements of early vision,' Computation Models of Visual Processing, Cambridge, MA: MIT, pp.3-20, Sep. 1991.
[2] P. Moon and D. E. Spencer, “The photic field,” MIT Press, pp. 3-20, 1981. [3] M. Levoy, and P. Hanrahan, “Light field rendering,” Proceedings of the 23rd Annual Conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, pp.31-42, July 1996. [4] B. Wilburn, N. Joshi, V. Vaish, E. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, “High performance imaging using large camera arrays,” ACM Trans. Graphics, vol. 24, pp. 765-776, July 2005. [5] B. Wilburn, N. Joshi, V. Vaish, M. Levoy, and M. Horowitz, 'High speed videography using a dense camera array, ' Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, July 2004. [6] C. Liang, G. Liu, and H. Chen, 'Light field acquisition using programmable aperture camera,' IEEE International Conference on Image Processing, pp. 233-236, Sep. 2007. [7] C. Liang, L. Lin, B. Wong, C. Liu, and H. Chen, 'Programmable aperture photography: multiplexed light field acquisition,' ACM Trans. Graphics, vol. 27, no. 3, pp. 55:1-55:10, Aug. 2008. [8] R. Ng, M. Levoy, M. Bredif, G. Duval, M. Horowitz and P. Hanrahan, “Light field photography with a hand-held camera,” Computer Science Technical Report CSTR 2005-02, Stanford University, Stanford, CA, USA, Apr. 2005. [9] A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, “Dappled photography: mask enhanced cameras for heterodyned light field and coded aperture refocusing,” ACM Trans. Graphics, vol. 26, no. 3, pp.69:1-69:12, July 2007. [10] C. Chen, Y. Lu, and M. Su, “Light field based digital refocusing using DSLR camera with a pinhole array mask, ”Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 754-757, Mar. 2010. [11] C. Chen, S. Fan Chiang, X. Huang, M. Su, and Y. Lu, “Depth estimation of light field data from pinhole-masked DSLR camera,” International Conferences on Image Processing, pp. 1769-1772, Sep. 2010. [12] T. Bishop and P. Favaro, 'Plenoptic depth estimation from multiple aliased views,' 12th IEEE International Conference on Computer Vision Workshops, pp.1622-1629, 2009. [13] T. Bishop and P. Favaro, 'Full-resolution depth map estimation from an aliased plenoptic light field,' The 9th Asian Conference on Computer Vision, part II,LNCS 6493, pp.186-20, 2011. [14] R. Ng, 'Fourier slice photography,' ACM Trans. Graphics, vol.24, no.3, pp.735-744, July 2005. [15] F. Perez Nava and J. P. Luke, 'Simultaneous estimation of super-resolved depth and all-in-focus images from a plenoptic camera,' 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, June 2009. [16] K. Kodama, K. Aizawa and M. Hatori, “Iterative reconstruction of an all-focused image by using multiple differently focused Images, “IEEE Proceedings of International Conference on Image Processing, vol. 3, pp.551-554, 1996. [17] M. Antunes, M. Trachtenberg, G. Thomas, T. Shoa, “All-in-focus imaging using a series of images on different focal planes,“ Proceedings of the 2nd International Conference on Image Analysis and Recognition, pp.174-181, 2005. [18] B. D. Lucas and T. Kanade, “An iterative image registration technique with an application in stereo vision,” 7th International Joint Conference on Artificial Intelligence, pp.674-679, 1981 [19] D. C. Marr and T. Poggio, “A computational theory of human stereo vision,” Proceedings of the Royal Society of London, B 204:301-328, 1979. [20] D. Scharstein and R. Szeliski, 'A taxonomy and evaluation of dense two-frame stereo correspondence algorithms,' International Journal of Computer Vision, vol. 47, no. 1, pp. 7-42, May 2002. [21] N. Asada, H. Fujiwara, T. Matsuyama, 'Edge and depth from focus,' International Journal of Computer Vision, vol.26, no.2, pp.153-163, 1998. [22] J. Ens and P. Lawrence, 'An investigation of methods for determining depth from focus,' IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.15, no. 2, Feb. 1993. [23] M. Subbraro and G. Surya, 'Depth from defocus: a spatial domain approach,' International Journal of Computer Vision, vol. 13, no. 3, pp. 271-294, 1994. [24] W. J. Tam and L. Zhang, '3D-TV content generation: 2D-to-3D conversion,' IEEE International Conference on Multimedia and Expo, pp.1869-1872, July 2006. [25] S. Battiato, S. Curti, M. La Cascia, E. Scordato, and M. Tortora, “Depth map generation by image classification,” Proceedings. of SPIE IS&T/SPIE's 16th Annual Symposium on Electronic Imaging, pp. 95-104, 2004. [26] Y. Chang, C. Fang, L. Ding, S. Chien, L. Chen, 'Depth map generation for 2D-to-3D conversion by short-term motion assisted color segmentation,' IEEE international conference on Multimedia and Expo, pp. 1958-1961, July 2007. [27] Y. Kao, C. Liang, L. Chang, and H. Chen, “Depth detection of light field,” Proceedings of IEEE International Conference on Acoustic, Speech, and Signal Processing, pp. 893-896, Apr. 2007. [28] V. Drazic, “Optimal depth resolution in plenoptic imaging, “Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1588-1593, Jul.2010. [29] T. Bishop, S. Zanetti, and P. Favaro, “Light field superresolution,” IEEE International Conference on Computational Photography, Apr. 2009. [30] T. Georgiev and A. Lumsdaine, 'Depth of field in plenoptic cameras,' In P. Alliez and M. Magnor, editors, Eurographics, 2009. [31] A. Lumsdaine and T. Georgiev, 'Full resolution lightfield rendering,' Adobe Tech Report, Jan. 2008. [32] R. Grunwald. “Micro-optics” in Thin film micro-optics: new frontiers of spatio-temporal beam shaping. Ed. Amersterdam: Elsvier, pp.7-8, 2007. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/63389 | - |
dc.description.abstract | 在本篇論文中,我們提出設計針孔陣列遮罩光場相機系統的方法,並依據拍攝之四維光場資料特性,我們提出演算法以達成深度估測,事後對焦,以及生成全對焦影像之應用,並且將深度估測演算法以積體電路系統實作達到即時運算的能力。
在論文的第一個部份,我們介紹文獻中利用微透鏡陣列光場相機記錄四維光場資料的方式。然而,微透鏡陣列製作成本昂貴、輸出影像的空間解析度低。 因此在論文的第二個部分,我們使用針孔陣列遮罩取代微透鏡陣列,提出針孔陣列遮罩光場相機系統的設計方法。並對針孔陣列遮罩光場相機紀錄之四維光場影像,分析其深度解析度與影像清晰程度的特性。 在論文的第三個部分,我們提出了用於單張四維光場資料的深度估測、事後對焦、以及生成全對焦影像演算法。我們實作的針孔陣列遮罩光場相機系統所拍攝的單張光場資料,經過我們所提出的演算法能夠達成多種影像應用。 在論文的最後一部分,我們以積體電路系統實作用於光場資料之深度估測處理器。在輸入為41×27×24×24之四維光場資料,輸出為解析度大小360×240之深度圖下,此處理器能夠於30毫秒內即時完成深度計算。此電路設計使用TSMC90奈米製程,電路面積為5.595〖mm〗^2,在操作頻率在100MHz下之功率消耗為105.7mW。 | zh_TW |
dc.description.abstract | Light field cameras can record the direction of light rays and thus providing possible applications which conventional cameras are not capable of. In this thesis, we propose a pinhole-array-mask light field camera and use the captured light field data for various applications in image processing. The hardware realization of the depth estimation algorithm is also proposed.
Compared with micro-lens arrays, a pinhole-array mask costs less and is easier when mounting to the camera. In order to use a pinhole-masked camera to capture 4-D light field data, we derive equations for selecting camera parameters and pinhole parameters, while considering characteristics of captured images, including its depth resolution and sharpness. Based on our proposed pinhole mask design equations, we implement a pinhole-array-mask camera. Captured 4-D light field images are processed by our proposed algorithms to achieve depth estimation, digital refocusing, and all-in-focus image generation. In the last part of the dissertation, we implement a depth estimation processor using TSMC 90 nm cell library. This processor operates at 100 MHz and is capable of processing a 41x27x24x24 light field data to a 320x240 depth map within 30 ms, which achieves real-time depth estimation capability. Its chip area is 5.595 mm2, and its power consumption is 105.7 mW. | en |
dc.description.provenance | Made available in DSpace on 2021-06-16T16:38:43Z (GMT). No. of bitstreams: 1 ntu-101-R99943022-1.pdf: 3964929 bytes, checksum: bd63837d0a4decdb460ffbabf6ce59af (MD5) Previous issue date: 2012 | en |
dc.description.tableofcontents | 目錄
致謝 ii 中文摘要 iii ABSTRACT iv 目錄 v 圖目錄 ix 表目錄 xi 第1章 緒論 1 1.1光場的意義與概念 1 1.2取得光場的方法 3 1.3場景深度估測 5 1.4事後對焦 7 1.5生成全對焦影像 7 1.6論文架構 8 第2章 微透鏡陣列光場相機 9 2.1微透鏡陣列光場相機 9 2.1.1微透鏡陣列光場相機設計 10 2.1.2微透鏡陣列光場相機具備之深度解析度 11 2.1.3微透鏡陣列光場相機具備之空間解析度 11 2.2微透鏡陣列光場相機2.0 13 2.2.1微透鏡陣列光場相機2.0記錄之光線方向特性 14 2.2.2微透鏡陣列光場相機2.0之設計 14 2.2.3微透鏡陣列光場相機2.0具備之空間解析度 15 2.3本章結論 16 第3章 針孔陣列遮罩設計 17 3.1針孔陣列遮罩光場相機之相關參數 17 3.1.1針孔直徑大小和針孔與針孔之間距離 18 3.1.2針孔陣列遮罩厚度 20 3.2針孔陣列遮罩光場相機具備之場景深度估測能力 23 3.3針孔陣列遮罩光場相機具備之深度解析度 24 3.4針孔陣列遮罩光場相機紀錄之影像清晰情形 25 3.5針孔陣列遮罩光場相機具備合成全對焦影像之能力 29 3.6針孔陣列遮罩光場相機實作 29 3.7本章結論 32 第4章 針孔陣列遮罩相機拍攝之光場資料之應用 33 4.1未經前置處理之拍攝光場資料 33 4.1.1遮罩擺設的角度傾斜 33 4.1.2透鏡的暈影效應 33 4.2經過前置處理後之光場資料 35 4.3深度估測演算法 36 4.3.1重複成像之各點位置座標 36 4.3.2比對方法 39 4.4事後對焦演算法 43 4.4.1事後對焦演算法 43 4.4.2具備對焦於極近物體的能力 46 4.5生成全對焦影像演算法 48 4.6本章結論 50 第5章 用於光場資料之深度估測硬體架構設計 51 5.1整體架構 51 5.1.1光場座標計算器 53 5.1.2讀取四維光場資料 54 5.1.3控制器 56 5.1.4區域資料項比對與信任係數計算器 57 5.2管線化架構設計 58 5.3硬體運算時間與記憶體使用量分析 59 5.3.1資料計算時間分析 59 5.3.2資料搬移時間分析 60 5.3.3整體運算時間分析 61 5.3.4記憶體使用量分析 62 5.4硬體結果 63 第6章 結論與展望 66 6.1結論 66 6.2展望 66 參考文獻 68 | |
dc.language.iso | zh-TW | |
dc.title | 適用於光場相機之針孔陣列遮罩設計與影像處理演算法 | zh_TW |
dc.title | Design of Pinhole Array Masks and Image Processing Algorithms for Light Field Cameras | en |
dc.type | Thesis | |
dc.date.schoolyear | 101-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 簡韶逸(Shao-Yi Chien),莊永裕(Yung-Yu Chuang),丁建均(Jian-Jiun Ding),王傑智(Chieh-Chih Wang) | |
dc.subject.keyword | 光場,針孔陣列遮罩,深度估測,事後對焦,全對焦影像,硬體設計, | zh_TW |
dc.subject.keyword | Light field,pinhole-array mask,depth estimation,digital refocus,all-focused image,hardware implementation, | en |
dc.relation.page | 70 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2012-09-26 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 電子工程學研究所 | zh_TW |
顯示於系所單位: | 電子工程學研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-101-1.pdf 目前未授權公開取用 | 3.87 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。