Lip Synchro

Hello All!

I’am proud to annonce that my script for lip synchronisation is released (beta).

How does it work: with Blender 2.40 alpha2, you could built the basic RVK for your character.

Then you use Papagayo:
http://www.lostmarble.com/papagayo/index.shtml
It’s under GNU Licence.

Then use my import script. It works…

I don’t have any web site yet, it’s in the pipe. You could see the result here:
http://blenderclan.tuxfamily.org/ht#forumpost31486

I actualy wrote a tutorial (RVK + Synchro). I just need a little help: i look for in the API the functiun to determine the name of a RVK.

Hope to help. If people want to join me, it’s with pleasure. Please mail me: dienben_mail@yahoo.fr

finally! but … where’s the -script- ?

this must be in the release version.

Thanks for your answers.

I just made a very basic tutorial:

http://blenderlipsynchro.blogspot.com/

The script and exemples are here:
http://afn.dalmont.free.fr/ben/

Please, give me your feedback!

Dienben

INCREDIBLE , Blenders ventriloquist.If only french language could be added it will be so nice.

Look here: http://www.blender3d.org/documentation/237PythonDoc/Ipo.IpoCurve-class.html

I think it must be either the getName method or name class.

I’m going to have to try this one out later… lovely!

Whoo! This is going to be useful :slight_smile:

Hello,

Just had a short talk about facial animation:
http://blenderlipsynchro.blogspot.com/

Dienben

Hello,

Today, i published a new release of the script (really easy to use now). Feedbacks are welcome!

Dienben

How would this translate to 3d shapes though?

Hello,

First, you need to define your 3D shapes. After that, you could use Papagayo to synchronise phonems and sound. Finally you use the script and map the sound with the mouth of your character.

Hope to answer to your question…

Dienben

wasn’t there a guy from this forum who wrote an open source app that does that? wouldn’t it be better to write the plugin for that app, since papagayo, like magpie, looks like it’s only free up until you use it commercially, right? plus it looked like good software. alot like magpie or this one if i recall correctly. coolio plugin. just about to try it out now…
<edit> well it looks like it’s free after all. my mistake.

good script. welldone. i’m glad to see the new version shows the name of the shape keys instead of numbers, because i seemed to be having an issue with them not being in the correct order from top to bottom in the blender ipo screen. ended up with “W”'s where i should have had “O”'s etc.

again thanks,
i’ll make good use of this script

Hello,

Today, a new release of blenderlipsynchro was published! It provide a full compatibility with Jlipsync:
http://JLipSync.sourceforge.net

Now, even if you under Linux, you could synchronyse sound and phonems, then map with your shapes in Blender. There some amelioration in the code too (english comment etc…)

Script is here:
http://afn.dalmont.free.fr/ben/blenderLipSynchro_12.py
My blog (tutorial…):
http://blenderlipsynchro.blogspot.com/

Hope to Help,

Dienben

I’m the author of JLipSync. Unfortunately, I won’t be able to test the script (I’m too lazy to put together a rigged Blender model and figure out RVKs ;)), but if there’s anything I can do to makeJLipSync work better with Blender, just send me an email.

I’d also suggest trying out Yolo, another lipsync program I wrote. It’s basically a clone of Lost Marble’s Papagayo. Like JLipSync, it’s written in Java, so it’ll run cross-platform. Also like JLipSync, it exports to Magpie format. In theory, Yolo should work with the JLipSync import script.

Yolo is still alpha, but I think you’ll find it a lot easier to use than JLipSync. And, of course, bug reports are welcome! :smiley:

Very nice work. I’m looking forward to giving this a try.

Hello,

Thanks for your reply. I just tested Yolo an d it look great. Congratulation for it! You could, of course, use Yolo to synchronise your phonems and use BlenderLipSynchro to map with your shapes!

Moreover, i’m basically a java programmer (with C++ Python, Lisp, prolog, but it’s another story :wink: ) so if you need some help, it will be with pleasure!

Dienben

Hello,

A little post to say that a new version of Papagayo is released:
http://www.lostmarble.com/papagayo/index.shtml

With Linux distrib!

Dienben

why don’t the two of you get together and make a native blender lipsync-er? so it could be a separate panel - like softbodies etc? or in sound panel? (Newspeak for blender … or likes)

Hello,

It’s not a bad idea :wink: .
I’ve some problem for the User Interface (like add a panel…), but if a ‘specialist’ of the Blender interface want to help, i’m your man!

Dienben

Hi every body !

Does anyone know someting about a saving mistake with Papagayo ?
Because I can’t save the work I do in Papagayo into a .pgo file.
I’m working with Windows XP and I tried to redownload it a few times, but it doesnt work.

Could anyone help me ?

Thanks !

Dany