Simultaneous 3-D motion estimation and wire-frame model adaptation including photometric effects for knowledge-based video coding

We address the problem of 3-D motion estimation in the context of knowledge-based coding of facial image sequences. The proposed method handles the global and local motion estimation and the adaptation of a generic wire-frame to a particular speaker simultaneously within an optical flow based framework including the photometric effects of motion. We use a… (More)