立體環場影像與立體環物影片整合之研究

Abstract

影像式塑模與描繪（Image-based Modeling and Rendering）是近年來大量發展的技術。環場影像是重現場景，讓使用者可以在固定的視點上去瀏覽場景中任意視角的技術。立體視覺則是利用讓人類左右眼分別看到場景中相對於左右眼的影像，使觀賞者可以感受到場景中的深度資訊。增添式環場影像（Augmented Panorama）可以讓我們在環場影像中加入虛擬的三維物件或是真實的環物影片並讓使用者可以互動的技術。我們的方法使用到上述的技術， 用影像式的方法建立立體環場影像（Stereo Panorama）與立體環物影片（Stereo Object Movie）之後，將立體環物影片整合到立體環場影像中，讓使用者可以與之互動。 我們提出了一個方法來整合立體環場影像與立體環物影片。在我們的方法中，使用者可以將立體環物影片放在立體環場影像中並在不同的立體顯示設備上展示與互動。我們提供了三種不同的方法讓使用者將立體環物影片擺在立體環場影像中適當的位置，並調整環物影片以達到較好視覺效果。另外使用者也可以在我們的系統中調整左右眼的視差來改善立體視覺的效果。我們也提出一個透過拍攝多張場景影像來合成立體環場影像的系統。

Image-based modeling and rendering draws lots of research works. Panorama, which has a fixed view position, is a technique to represent virtual or real scenes and viewers can view scenes at any viewing direction. Stereo vision makes human sees depth perception by presenting two eyes different images which are taken from different viewing positions of a scene. Augmented panorama is a technique which we can add virtual objects or object movies into panoramas and users can interact with those objects. Our work involves above techniques. We use image-based methods to generate stereo panorama and stereo object movies and propose a method to add stereo object movies into stereo panorama. In this paper, we proposed a method which combines stereo panorama with stereo object movies. In our system, the user can put stereo object movies into stereo panorama, display results on different stereo devices and interact with it. We provide three different methods for user to integrate stereo object movies into stereo panoramas. Our system also processes stereo object movies to increase visual effects. And the user can interactively adjust the depth perception of stereo object movies. We also provided a system to generate stereo panoramas.