可應用於舞台表演之互動多媒體系統

Abstract

近年，多媒體特效已廣泛被使用於表演舞台。利用多媒體特效，導演能盡情發揮想像力及創造力，帶給觀眾不同以往的視覺感官享受。但在現今舞台表演中，多媒體特效驅動的時間、位置的精確度仍是必須克服的問題，即使是最精確的感測器也無法保證百分之百的準確度。因此在現場表演，多媒體特效師的存在是不可或缺的，且為了讓表演有能夠有更精彩的演出，特效控制師期盼能有更簡單明瞭、更有彈性的介面來操控特效。 為解決上述問題，我們實作互動多媒體特效系統：iM-stage：建立攝影機與投影機系統，使用深度攝影機捕捉黑暗舞台上的物件，同時將捕捉到的影像與物體輪廓資訊傳送至界面簡單易操作且支援多指觸控的平板。在細節部分，本論文會說明如何校正與利用深度攝影與投影機系統，建立舞台的立體環境，將影像轉換為投影機視角，達成動態的實物投影。平板上會呈現投影機的視角所觀看的舞台空間，多媒體特效師可直接觸碰平板上的物體讓投影機投射出相對應的特效，藉此更能隨心所欲地與舞台表演者互動。 我們提出了iM-stage，此系統不僅能解決劇場表演上操控多媒體特效的繁瑣流程，也能提高舞台表演特效的彈性及吸引力，帶給觀眾更多不一樣的舞台表演體驗。

Multimedia contents are used widely on recent stage performances, which would give the show a totally different presentation, enabling the directors thoroughly express their creativity and innovation, bringing a great visual experience to the audiences. However, the timing and locational accuracies of triggering the effects become big issues in the contemporary performances, and even the dedicated sensors could not provide perfect accuracy which is necessity for live stage performances. Hence, the effects conductors became indispensable for the live show. To enhance the qualities of the performances, the conductors are eager for a more flexible and effortless control interface to manipulate the effects. We proposed the iM-stage – an interactive multimedia effects system, which built up a camera-projector system; depth cameras are used as observers and projectors as outputs. It also provided a convenient interface on multi-touch supported tablets. We explained the calibration method, using the well-calibrated depth cameras to generate the 3D scene of the platform and transformed it into the projector view image, making the dynamic-object projection mapping possible. The tablet interface also displayed the image, allowing the effects conductors to manipulate effects directly on the objects showed on the tablet and interact with the performers on the stage. Our work, iM-stage, can not only reduce the complicated procedure for control multimedia effects, but also enhance the flexibility and attractiveness of stage performance.