Adaptive haptic rendering for time-varying haptic and video frame rates in multi-modal interactions

Abstract

In multi-modal interactions including haptics, problems such as input sensor noise, temporal mismatch between graphics and haptics, and non-constant refresh rates may cause non-smooth force/torque display. This paper proposes temporal smoothing technique for haptic interaction using a sensing glove in multi-modal applications. The proposed technique employs two processes: (1) a noise reduction method is applied to reduce jitter noise at the sensors in the sensing glove and (2) an adaptive force extrapolation is applied for time-varying haptic and video frame rates. To demonstrate the performance of the proposed method, We developed a test platform to assess a simple box model and relatively complex models such as gamephone, portable media player (PMP) It was subsequently demonstrated that the proposed method can support smooth haptic interactions in multi-modal applications where a haptic device and a sensing glove are used. Copyright (D, 2009 John Wiley & Sons, Ltd.