視覺 Fidget 互動：範例、設計框架與混合實境中的創作工具

Abstract

Fidgeting 泛指人類為了自我調節而進行的低強度、重複性的動作。雖然傳統上這種行為根植於觸覺體驗（如擠壓或輕敲），但近期的研究開始探索透過視覺介面來豐富這類行為，並擴展其表達潛力。然而，現有的方法鮮少將「Fidget 動作」與「回饋」之間的映射關係正式化，且往往依賴於特定的工具，這與日常自然的動作有所脫節。為了彌補這一缺口，我們開發了一套混合實境創作系統，旨在以日常的 Fidgeting 為基礎，進行視覺化的設計。我們展示了該介面的工作流程，並詳細介紹了從前置研究中提取出的基礎可供性映射。研究結果展示了 10 款由使用者創作的視覺設計及其相應的映射策略。

Fidgeting involves low-effort, often repetitive hand movements used for self-regulation. While traditionally grounded in haptic experiences such as squeezing or tapping, recent research explores visual medium to enrich fidgeting and extend its expressive potential. However, these approaches rarely formalize gesture–feedback mappings and often rely on specialized tools that diverge from natural, everyday gestures. To address this gap, we developed a mixed reality (MR) authoring system that enables visual fidget design grounded in everyday fidgeting behaviors. We demonstrate the workflow of our interface and walk through the underlying affordance mapping extracted from our formative study. Our results show 10 user-created visual fidget designs with mapping strategies.