請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/59326
標題: | 光場相機之取像以及影像解模糊與影像內插技術 Advanced Light Field Image Acquiring, Deblurring, and Interpolation Techniques |
作者: | Chia-Chun Hsu 徐嘉駿 |
指導教授: | 丁建均(Jian-Jiun Ding) |
關鍵字: | 光場影像,白場影像補償,影像解模糊,雙L0 模糊函數估測,影像結構抽取,L0-L2 反捲積,影像內插,三次捲積,最小誤差臨界值, light field image,white image compensation,image deblurring,Dual-L0 blur kernel estimation,L0-L2 deconvolution,cubic convolution,minimum error thresholding, |
出版年 : | 2017 |
學位: | 碩士 |
摘要: | 由於硬體以及影像處理技術的快速提升,光場相機的研究以及應用如同雨後春筍一般快速的被提出。有別於傳統相機只能捕捉場景中的位置資訊,光場相機能紀錄空間中的光線位置與角度資訊。因此,光場相機可以做到重新對焦、改變視角以及3D 立體圖重建的功能。然而,目前的光場相機常常受到影像模糊以及解析度不高的問題,使得最後重建影像品質不佳。有鑑於此,在本篇論文中我們針對光場影像設計一套包含影像重建、影像解模糊以及影像內插的系統,並分別針對這三個部份分別提出新的方法;其中,解模糊與影像內插的部分甚至可以應用在任何自然影像上。
在取像的部分,由於我們的光場影像受到衰減效應的影響,導致既有的方法無法順利產生高品質的影像。因此,我們提出先利用白場影像擷取相機的衰減曲線並估測出補償模型來還原無衰減的影像。不過由於白場影像的光源與實際影像的光源不同,會造成部分影像有過度補償的情況,導致最終影像仍有些許失真。針對這個問題,我們也定義了一個適應性的函數來針對不同的影像調整其補償模型。在最後的實驗結果指出我們所提出來的方法相比於既有的方法可以重建出較高品質的影像。 在影像解模糊當中,由於許多現有的方法以效率換取了效果,使得這些演算法雖然效果優良但是效率極差。在本篇論文中,我們提出了雙L0模型來估測模糊函數,由於模糊函數一般具有稀疏性,比起L2或是L0模型,利用雙L0模型可以更精準的估測模糊函數並減少雜訊。為了更進一步減少雜訊,在估測模糊函數時我們也引進了影像結構抽取的概念,將模糊函數本身作為影像結構而雜訊當作是紋理來得到更精確的函數。此外,我們在估測中繼影像時所採用的輸入為影像結構的梯度而非影像梯度本身,以減少影像中雜訊對於模糊函數估測時的干擾。在最後模糊影像還原的部分,我們也提出了高效率的L0-L2 反捲積演算法,讓最終的影像能夠在短時間內被重建出來。實驗結果顯示,我們提出的方法相比於既存的演算法可以在最短的時間內還原出最高分數的影像。 為了讓低解析度的光場影像能夠在放大到高解析度的同時不流失過多的影像細節,我們也提出了一個改良版的方向三次捲積內插演算法。此演算法會先計算欲內插像素的梯度方向,當某個方向的梯度值大於一個臨界值,則沿著垂直於梯度方向的方向進行三次捲積內插。若梯度值都很小或是很大,則將沿著兩個互相正交的方向的內插結果利用線性組合算出像素值。為了使方法更穩定,我們引入了最小誤差臨界值演算法來對於每個影像產生其較佳的臨界值。在保留影像細節的部分,我們也引進了影像結構抽取方法來分離影像細節與結構。對於影像結構的內插是採用上述的方法;而影像細節的部份我們則另外提出一個以區域梯度為導向的內插演算法。模擬結果顯示,提出的方法相比於現有的方法可以獲得較高的分數,並且也提供最佳的視覺效果。 Due to the fast developments in hardware and image processing techniques, the researches and applications of light field camera are springing up like mushrooms. Different from the conventional camera which can only capture position information in the scene, light field camera is able to record both position information and angular information of light rays. As a result, light field camera can realize the refocusing, changing perspective, and 3D stereo image reconstruction. However, light field camera usually suffers from the problems of blur and lack of resolution which yield the poor quality in the final image reconstruction. Based on this viewpoint, we design a system for the light field camera which consists of image rendering, deblurring, and interpolation. For each part of this system, we propose new methods respectively where the deblurring and interpolation parts can even be used to any natural image. In the image rendering part, existing methods are not able to generate the high quality rendering results due to our light field images suffer from the attenuation effect. Hence, we suggest to record the attenuation model of light field camera from the white image and estimate the compensation model to recover the original image. Due to the difference between the light source of raw image data and white image, the phenomenon of overcompensation will occur and cause some artifact in the final image. To address this problem, we define an adaptive function to adjust the compensation model for different images. Simulation results indicate that the proposed method can render images with higher quality than existing methods. For the image deblurring, due to many existing methods sacrifice the efficiency for higher performance, these methods have good performance but poor efficiency. In this thesis, we propose a dual-L0 model to estimate the blur function. Since the blur function usually have high sparsity, compared to L2 or L0 model, using dual-L0 can not only estimate the blur function more precisely but also reduce the noise. To further reduce the noise in the blur kernel, we employ the structure extraction to our blur kernel estimation which views the blur function as image structure and the noise as texture. In addition, we use the gradient of structure image to estimate the interim image instead of the gradient of original image which can reduce the interference from the noise in the images. In the final blurring image reconstruction part, we also propose a high efficiency L0-L2 deconvolution algorithms so that the final image can be reconstructed in a short time. The experimental results show that the proposed method can recover the highest score image in the least computation time. To zoom a low resolution light field image into high resolution one without losing too many details, we also propose an improved directional cubic convolution interpolation algorithm. This algorithm will first estimate the gradient direction of the missing pixel and interpolate the missing pixel along the direction that orthogonal to its gradients direction by the cubic convolution interpolation. If two of the orthogonal gradient are either very small or very large, the missing pixel is interpolated by the linear combination of the interpolation results along these two orthogonal directions. To stabilize the performance, we apply the minimum error thresholding to determine the better thresholding for each image. In order to preserve the image details, we also apply the image structure extraction to separate the details and structure of an image. For the interpolation of image structure, we use the above method, while we propose another interpolation scheme based on the local gradient to interpolate the image details. Simulation results show that the proposed method gives higher performance then existing methods and also have the best visual quality. |
URI: | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/59326 |
DOI: | 10.6342/NTU201701280 |
全文授權: | 有償授權 |
顯示於系所單位: | 電信工程學研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-106-1.pdf 目前未授權公開取用 | 9.07 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。