3D場景之風格轉換

Abstract

風格轉換是計算機科學中的熱門話題，有很多研究試圖將圖片轉換為給定的風格，此外產業界也有一些相關的應用與服務。隨著頭戴式顯示器的發展，3D多媒體內容的製作需求增加，例如遊戲和虛擬實境的應用程式。由於製作特定風格的場景是件費時費工的事，所以我們將風格轉換加入到內容製作的流程中。然而，這些研究大部分都專注在2D圖片上，因此我們修改這些方法來達成我們的目標。 在這篇論文中，我們提出了一個將3D場景轉換為繪畫風格的方法。在前處理時，我們轉換表面色彩貼圖的風格，並根據轉換過的貼圖生成法向量貼圖和位移貼圖。在場景實際運行時，我們調整光影效果及添加輪廓來增進轉換的效果。最後，我們展示使用不同部分的風格圖片來進行轉換的效果，並探討執行時的效能。

Style transfer is a popular topic in computer science. There are lots of works try to turn an image into the desired style. In addition, there are some popular commercial products. With the growth of head-mounted display, the demand of 3D multimedia content is increasing, such as games and virtual reality applications. Due to creating a scene in a particular style is time-consuming, we take style transfer into the design process. However, most of these works focus on 2D images. We modify these methods to reach our goal. In this thesis, we propose a method to transfer the 3D scene style by a specific painting. In the preprocessing stage, we transfer the style of albedo maps. We also generate normal maps and displacement maps according to the transferred albedo maps. In the runtime, we tune the lighting effect and add silhouette to improve the transferred result. Finally, we demonstrate the result of transferring objects by different areas of the style image and discuss the runtime performance.