lip sync attempt

using luddy hes the man my hero you no he rules. tell me how to fix. the way i did it was by loading my audio into le blend(blender) and found out wen a word ended and began and used a mirror to copy how it looks to say that word. its was harder than usual but magpie sucks and makes luddy look like a finger pupet. the words might not match exactly but i was just trying to get a smoother talk

http://www.youtube.com/watch?v=HjC8ULrtVZw

Not bad, but a couple of ideas.

If you have a video camera or even a webcam, try filming yourself saying the phrase. Practice it then recite it to video.

You can then import the video into blender within it’s own little preview window for reference. Get ludwig all prepared, set your framerate to what you want, then start to piece together the key mouth shapes.

I used this technique once on a friend’s dialogue and it worked a treat. :smiley:

could u show me your results???

This was done last year. Purely out of curiosity. It’s not very long, and I don’t have the original source footage to hand. (not that I’d show it because it features a friend who’s permission I don’t have). :wink:

Suffice to say, the lip-sync and shapes are pretty damn close to how the guy performed the line, on the day. :smiley:

mmm… Pineapple

In the attached image you can see the GUI layout I used. Bottom-left is the output from JLipsync/Magpie as a frame reference. The empty window with the 3D cursor is where I had the real captured footage of the dialogue.

Hope this helped. :wink:

Attachments


The single biggest secret (don’t tell ANYBODY) for lip-sync is to ignore most of the “letters” in the speech. We don’t sound individual letters when we say words. We make sounds and those sounds string together to make things we recognise as words.

It looks like your guy is sounding almost every letter in the audio - that’s why his lips are flashing around faster than the eye can see. Make sure you hit the important shapes like “F, V, OOO, EEE”. And don’t worry too much about the vowel sounds that join it all together.

Secret number two is that the lips aren’t the most important part of lip-sync. What really makes things work is the whole facial expression, head movement and even body movement. Keep practising with the lips but slowly bring in some facial expression too. Then work on the rest. When it all comes together, it works (hopefully).

If you haven’t seen it before, here’s my attempt at that same audio clip.
http://members.westnet.com.au/andydolphin/blender/attitude4.mpg

I think it took about a fortnight to make - this was the third revision and his movements got bigger each time.

There’s also some great advice about lipsync in the tutorial section at http://www.keithlango.com

i can see wat ur getting at, great technique, thanks,

thanks for the tip, makes sence and is probebly my problem.