一種用於全景立體影像生成的輕便式多視角相機 系統

Abstract

本論文提出一個輕便式的多視角相機以及演算法以拍攝並生成全景立體圖。這個多視角相機只由四個魚眼相機構成。只經由四個視角生成全景圖非常具有挑戰性，因為各個相機的視角非常不一樣，還有魚眼影像本身會有投影扭曲，以及包含暗暈（vignetting），對比降低（contrast loss），和模糊（blurriness）等畫質衰退的問題。 為了處理這些問題，本論文提出一套系列演算法，進行多視角影像校正，估計場景深度，並且生成全景立體影像。本論文提出的多視角相機將多個魚眼相機緊密地集合在輕量且低成本的裝置。伴隨的系列演算法可以將此多視角相機拍攝的影像合成為視覺上舒適自然的全景立體影像。現在已有一個相機原型產生，並且應用在深度多變的場景拍攝當中。實驗結果顯示本論文提出的多視角相機模型與演算法可以有效地產生在一般常見的虛擬實境顯示器播放的全景立體圖。

This dissertation proposes a low-cost and portable polycamera system and accompanying methods for capturing and synthesizing stereoscopic 360° panoramas. The polycamera consists of only four cameras with fisheye lenses. Synthesizing panoramas from only four views is challenging because the cameras view very differently and the captured images have significant distortions and color degradation including vignetting, contrast loss and blurriness. For coping with these challenges, this dissertation proposes methods for rectifying the polyview images, estimating depth of the scene and synthesizing stereoscopic panoramas. The proposed camera is compact in size, light in weight and inexpensive in cost. The proposed methods allow synthesizing visually pleasing stereoscopic 360° panoramas using the images captured with the proposed polycamera. A prototype polycamera has been built and tested on a set of scenes with different characteristics on depth ranges and depth variations. The experiments show that the proposed camera and methods are effective for generating stereoscopic 360° panoramas that can be viewed with popular virtual reality displays.