互動式風格轉換在虛擬藝廊的應用

Abstract

近年来，由於疫情的爆發，許多活動都改為線上的方式舉辦以避免疫情擴散，如虛擬藝廊。然而，在目前的虛擬藝廊中，無論是策展人或是觀賞者皆只能對藝術品進行有限的操作，為此我們希望透過風格轉換來讓策展者能夠藉此技術發展更多元的體驗形式，並讓觀賞者透過風格轉換的過程增加對於藝術品的認識，加深與藝術作品的連結。在本篇論文中，我們提出了一個互動式風格轉換虛擬藝廊系統，在系統設計階段，我們比較不同風格轉換方法產生的結果，並根據文中提及的考量因素選擇其中兩種方法整合至我們的系統。接著，使用者可以透過使用者介面對虛擬藝廊中的畫框、卡紙、圖片、以及3D藝術品進行風格轉換。最後，我們進行了一項使用者研究來評估本系統的有效性。结果顯示，在虛擬藝廊中加入風格轉換不只能夠增添虛擬藝廊體驗的豐富性，對於提升藝術品的美感也有一定的幫助，對於觀賞者而言，不僅能在觀賞過程中增添趣味性，更能藉由選擇不同風格的過程，加深對於藝術品的印象。

In recent years, due to the outbreak of the epidemic, many events have been held online to avoid spreading illness, such as the virtual gallery. However, in the current virtual galleries, both curators and viewers can only do limited manipulation of the artwork. Therefore, we hope that through style transfer, curators can use this technology to develop more diversified forms of experience, and viewers can increase their understanding of the artworks and deepen their connection with the artworks through the process of style transfer. In this thesis, we propose an interactive style transfer virtual gallery system. In the system design phase, we compare the results of different style transfer methods and select two of them to integrate into our system based on our considerations. Then, users can perform style transfer on pictures, paper jams, frames, and 3D artworks in the virtual gallery through the user interface. Finally, we conducted a user study to evaluate the effectiveness of this system. The results show that adding style transfer to the virtual gallery not only increases the richness of the virtual gallery experience, but also enhances the aesthetics of the artwork. For the viewers, it not only makes the viewing process more interesting, but also deepens the impression of the artwork through the process of choosing different styles.