建立一個具有自然使用者介面的可攜式與沉浸式擴增實境之拆卸訓練系統

Abstract

Augmented reality (AR) is an increasingly discussed topic with major research efforts focused on industrial applications in the recent years. Recent developments in ideas, software and hardware opened up new opportunities, and the applications of AR for virtual assembly and disassembly have great potential. Compared to real world tasks, virtual disassembly allows users to complete tasks with lower cost and without exposure to environmental danger. The simulation of realistic real world interactions within a virtual world therefore becomes an essential issue to solve. This research develops an AR-based disassembly training system, which provides users with a natural user interface that allows them to manipulate objects using their bare hands, without additional worn or handheld devices on their hands. Multiple coordinate systems are unified, the issue of creating and updating the dynamic coordinate transform between that of the Oculus Rift, Leap Motion, RGB camera, and the AR marker which represents the real world is solved. To resolve issues with occlusion and increase the immersion and perceived realism of the system, an innovative occlusion approach proposed to minimize computational load. A flexible physics-based disassembly system is implemented to handle part disassembly. The physical tools can be used in the system. User test results show that the system was robust and successful in improving user experience in virtual disassembly.