Multimodal Gumdo game: The whole body interaction with an intelligent cyber fencer

Abstract

This paper presents an immersive multimodal Gumdo simulation game that allows a user to experience the whole body interaction with an intelligent cyber fencer. The proposed system consists of three modules: (i) a nondistracting multimodal interface with 3D vision and speech (ii) an intelligent cyber fencer and (iii) an immersive feedback by a big screen and sound. Firstly, the multimodal interface allows a user to move around and to shout without distracting the user. Secondly, an intelligent cyber fencer provides the user with intelligent interactions by perception and reaction modules that are created by the analysis of real Gumdo game. Finally, an immersive audio-visual feedback helps a user experience an immersive interaction. The proposed interactive system with an intelligent fencer is designed to satisfy comfortable interface, perceptual intelligence, and natural interaction (I-cubed) and enhance the life-like impression of fighting actions. The suggested system can be applied to various applications such as education, art, and exercise.