I’m pretty sure this has been done before, but this is my take at it. All is explained in the video.
Update with an armature system driving the mesh deformation.
A great test, Blazraidr! While it is just a rough concept, you attained some interesting, organic feeling results. The quirks are also interesting, the way the top of the head increases and decreases as your brow moves, for example.
Do you feel that more points would be beneficial, or that being able to capture a second camera perspective would be more useful? I suspect some of the unnatural movements are due to only having 2D tracking data.