Using an adaptive VAR model for motion prediction in 3D hand tracking

Abstract

A robust VAR-based (vector autoregressive) model is introduced for motion prediction in 3D hand tracking. This dynamic VAR motion model is learned in an online manner. The kinematic structure of the hand is accounted for in the form of constraints when solving for the parameters of the VAR model. Also integrated into the motion prediction model are adaptive weights that are optimised according to the reliability of past predictions. Experiments on synthetic and real video sequences show a substantial improvement in tracking performance when the robust VAR motion model is used. In fact, utilising the robust VAR model allows the tracker to handle fast out-of-plane hand movement with severe self-occlusion. Show more