Hello all!
Wish you are well.
I have started an animation page basically, learned how to use procreate dreams to express my ideas via animation. I have million ideas but takes so long to do, which I don’t mind. But what particularly kills me is manually moving the lips/mouth per sound and even in a 90 second clip it takes me about 5-9 hours to do. This part is putting a damper on my motivation and I really am determined to keep it going.
I found blender and rhubarb auto lip sync to be a potential cure for my issue. But I’m not sure how to go about it , and because it’s so specific it’s hard to find YouTube videos on it.
All I want is for my characters mouths to move automatically with the sounds. I have a mouth shape for the some characters already ready.
If someone could help me overcome this, I will truly be forever grateful.
Thanks for your time reading this.
It’s not possible - unless you make 3D characters and render them out as an image sequence, then import that in Dreams. There’s no way to connect Dreams to Blender otherwise
Procreate is iPad only still, correct? In this sense, you can paint your characters in layers in Procreate but you’d have to export your layers as images and bring them into Blender on a desktop or laptop. If you can get COA Tools addon, you can do cutout animation with your images in Blender. Still a lot of work, but Ndee updated for 4.1 if I read that correctly.
Damn, chat gpt gave me hope that it’s possible, so I can’t upload the scene (video sequence) and leave the mouth blank and get rhubarb to do auto lip sync then ?
Yes mate that’s correct mate. Aahhhh so it’s not as easy as chat gpt makes out. I have the whole scenes ready just need the mouths to move automatically. I mean in some video styles the character doesn’t move at all. Essentially he’s standing beside a screen explaining the content displayed
Its good for stop-motion / cell style lipsync with 9 mouth shapes and no tweening between em. I also did some tutorials on how to use Rubarb with Blender. Not sure if the addon will still work as it uses the pose lib and tbats been replaced by the library.
Ah that’s some good work man. So everything on blender u must create essentially. For e.g if Homer Simpson didn’t have a mouth, and i put his image on blender and an audio over it , it would work? Unless I try and draw him from scratch?
