matchmoving-compositing?

Wondering how to uv map a vidio to a blender mesh that represents some part of the footage for example a wall after using match moving to sync blenders camera to the actual footage- and save the mapping as a vidio or sequence. Tried uv project modifier projected from the matched camera which projects the footage accurately but i still need a way to bake as it were every frame to a flattened uv layer of the wall so that i can then remap the baked vidio and change the walls shape thus deforming the original footage which i then plan to recomposite back over the original footage.
Basically what they do when they film animals and remap them to their virtual meshes- allowing them to animate their faces and make them talk etc.