基於多種單眼線索之深度估測

Abstract

三維視覺呈現(3-D display technology)是近年影像處理研究與產業界十分關注的議題。在產生三維視覺效果時，通常需要仰賴深度圖(depth map)來重建三維視覺的立體效果，目前市面上電影產業常用的深度圖產生方法通常為採用人工手繪的方式，耗費大量的成本和時間。為了降低製作深度圖的成本，許多針對自動或半自動生成深度圖的研究在近年來成為研究的焦點。 本篇論文提出一個三層架構系統：首先對影像進行分析，取得場景資訊，然後利用絕對深度探測與相對深度探測產生完整的深度圖。此方法可以應用在單張圖片或影片上，針對影片的輸入，特別另外使用了時序一致性(temporal coherence)的條件以求得更一致的結果。 實驗結果顯示此方法除了能夠有效成功的偵測出深度，隨著相關演算法的進步，此方法也能更趨近於全自動，同時這個方法也是對於深度探測的問題提供了一個新的方向發展。

3-D display technology is one of popular topics in recent years. In the process of generating 3-D visual perspective, depth map plays an important role in rebuilding the stereoscopic effect. So far, manually drawing the depth map is the mainstream in movie industry. However, it costs lots of money and time. Therefore, many automatic and semi-automatic depth estimation methods have been published in recent years. In this thesis, a three-phase and semi-automatic system is proposed. First, the input image/frames are analyzed to extract the information of scene. Then absolute depth estimation and relative depth estimation are employed to generate depth map. The proposed system is applicable to both single image and image sequence. For sequence inputs, temporal coherence is obtained to make the depth maps between frames being smooth and continuous. The experimental results show that this method can estimate depth successfully. The effectiveness of the proposed system also gives development for automatic depth estimation. With the improvement of segmentation algorithm, generating depth map automatically will come true in the future.