Mediapipe is impressive. It is much faster than OpenPose and Wrnch and usually self-reports 100% accuracy, even for hands. It even runs on smartphones. For an example of python programming with Mediapipe see: https://www.youtube.com/watch?v=EgjwKM3KzGU
A good start on a Mediapipe plugin for Blender is at https://github.com/zonkosoft/BlendyPose This plugin worked well with Blender 2.92 but has a problem with changes made in 2.93. The developer is asking for contributions to the code.
Thanks for sharing the link @Aurosutru
Today was released a new version with a better mediapipe data import and even a menu to make the loading of video easier.
As a bonus, there is also a vroid rigged model and remap files to use with rokoko retargeting solution or autorigpro.
Thanks for your work Carlos! I am wondering, is your work open sourced? I am currently starting some research for an “avialable for everyone” solution to capture signs for sign language and I find your work very interesting. I’d be happy to contribute if I can.
Thanks for the words.
It is open source.
The main code is in this link
The other links here on this post, are from some tests I’m doing before adding to mocap_import (the full addon)
I never worked with somebody helping on the code, and to be honest I dont know how to deal with some other things, like, I receive donations for the addon on gumroad and patreon, and I dont think its fair for me to receive for somebody else works and neither I have an idea of how to split…
I didnt think somebody would want to be part of it
Nice to hear it’s on github! I am not interested in money so don’t worry about that. This is some research I am doing, so it makes sense to me to contribute to work already being done instead of reinventing the wheel. Not that I am an expert in animation anyway.
I’ll be experimenting with your plugins for a few days and then I’ll try to contribute if I can. Thanks again!
Can the output be made smoother? Significant jerking is seen in the Michele video you posted and in results from my test input videos, though the video motions themselves are smooth. Can the smoothing code found in BlendyPose be incorporated? It works well there.
My research is done in Universidad Pompeu Fabra for the european SignOn project (https://signon-project.eu/). Currently in early stages, but the idea is to ease the communication between Deaf, hard of hearing and hearing people.