Results 1 to 3 of 3
  1. #1
    Member Aschenstern's Avatar
    Join Date
    Feb 2017

    Animation - Music Sync

    Hello fellow blenders,

    I know this question has been probably asked a ton of times. But the thing is : even after soing some extent research i didnt really find a good solution so i wanted to ask you guys, maybe i misunderstood something.

    So i have prepared some scenes and own rigged models to do a music video. Basically i have a song and i want to animate the models to it. The tricky part is: i want them to syn exactly to the music/beat.
    For example : lip sync for singing but also mathed movements for example hand clapping etc.

    I tried using the audio scrub method. But for me it didnt really work out : even with waveforms and scrubbing i cant really make our any word sang in the song , not even speaking about my animation being syncronised with the music.

    So , does anyone know a good way to do it? Maybe i misunderstood something?
    Because i cant imagine how to do a good synced animation by using such methods.

    Thank you so much!

  2. #2
    Member Mousy's Avatar
    Join Date
    Jan 2016
    Use pose library for reusable set of phoneme poses and use them. It is extremely difficult to separate voice from music for automation. This requires a well-trained neural network. Therefore the animation of singing should be done manually. It's difficult, but it's possible.

    For animation of dance, you can record movement of some bones with the mouse, then smooth or simplify curves, then manually do adjustments, focusing on the recorded movements of the parts of the rig

    You can use the NLA editor to assemble a complex dance from simple actions.

  3. #3
    Member clockmender's Avatar
    Join Date
    Nov 2014
    East Leicestershire, UK
    See this thread:

    And this one:

    Then look at my Youtube channel (in my signature at the bottom of this post) at some of the latest vids, then let me know if you want to take this approach further. it requires a MIDI file to animate exactly to the music. I have my Human model tapping one of her feet to the beat now, ready for a later video of the "Clockophone".

    I have written some MIDI Sync nodes as an add-on top Jacques excellent Animation Nodes.

    Cheers, Clock.
    Last edited by clockmender; 21-Nov-17 at 15:21.
    K.I.S.S - a good maxim I think, and Granddads know best!
    "You are completely bonkers." - @Gumboots
    Youtube Channel Website Still rebuilding this, but it is started at last

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts