Clonemator: 在虛擬實境中組合時空分身以創建互動式自動化工具

Abstract

Clonemator 是一個虛擬實境（VR）系統，讓使用者建立分身並在時空上安排他們，以創建出自動化工具來完成複雜的任務。分身可以（1）定格使用者的身體姿勢成為靜態物體、（2）同步地模仿使用者的動作，以及（3）重播使用者在一段時間中的一連串動作。結合像是縮放、位置重新排列、群組選擇和複製等傳統技術，Clonemator 讓使用者透過將復雜的任務分解為一系列與分身的合作，來迭代開發出客製化且可重複使用的解決方案。這避免了實作專用的互動技術或程式，同時允許在 VR 應用中進行靈活的互動。我們透過多個例子來展示 Clonemator 的靈活度，並透過初步的使用者研究來驗證它的易用性和有效性。最後，我們討論 Clonemator 在遊戲機制、空間互動、多機器人控制等應用的潛力，並為未來的研究提供我們的見解。

Clonemator is a virtual reality (VR) system allowing users to create their avatar clones and configure them spatially and temporally, forming automators to accomplish complex tasks. In particular, clones can (1) freeze at a user's body pose as static objects, (2) synchronously mimic the user's movement, and (3) replay a sequence of the user's actions in a period of time later. Combined with traditional techniques such as scaling, positional rearrangement, group selection, and duplication, Clonemator enables users to iteratively develop customized and reusable solutions by breaking down complex tasks into a sequence of collaborations with clones. This bypasses implementing dedicated interaction techniques or scripts while allowing flexible interactions in VR applications. We demonstrate the flexibility of Clonemator with several examples and validate its usability and effectiveness through a preliminary user study. Finally, we discuss the potential of Clonemator in VR applications such as gaming mechanisms, spatial interaction techniques, and multi-robot control and provide our insights for future research.