Machine learning Puppeteer animation

Using machine learning connected to web cam to view markers on a ball and joint snap-fit 3d printed model to then animate figures in the real world and update them in the digital one.

using color coding and markers to identify limbs and their position on the figures and calculating back their position on the 3d model. markers might include plus’s hexagon, cube, triangles size of the marker and color code.

I am think of printing the figure in white then using a permanent marker to color the area’s

The model would be floating using an adjustable arm at the tail-bone. you would then be able to have multiple figures in a scene, as long as some or most of a limb is identifiable to pick up on position and rotation.


if anyone is interested in working with me on this project please let me know.