Results 1 to 3 of 3
  1. #1
    Member Aschenstern's Avatar
    Join Date
    Feb 2017
    Location
    Germany
    Posts
    18

    Animation - Music Sync

    Hello fellow blenders,

    I know this question has been probably asked a ton of times. But the thing is : even after soing some extent research i didnt really find a good solution so i wanted to ask you guys, maybe i misunderstood something.

    So i have prepared some scenes and own rigged models to do a music video. Basically i have a song and i want to animate the models to it. The tricky part is: i want them to syn exactly to the music/beat.
    For example : lip sync for singing but also mathed movements for example hand clapping etc.

    I tried using the audio scrub method. But for me it didnt really work out : even with waveforms and scrubbing i cant really make our any word sang in the song , not even speaking about my animation being syncronised with the music.

    So , does anyone know a good way to do it? Maybe i misunderstood something?
    Because i cant imagine how to do a good synced animation by using such methods.

    Thank you so much!



  2. #2
    Member Mousy's Avatar
    Join Date
    Jan 2016
    Location
    Ufa
    Posts
    7
    Use pose library for reusable set of phoneme poses and use them. It is extremely difficult to separate voice from music for automation. This requires a well-trained neural network. Therefore the animation of singing should be done manually. It's difficult, but it's possible.

    For animation of dance, you can record movement of some bones with the mouse, then smooth or simplify curves, then manually do adjustments, focusing on the recorded movements of the parts of the rig

    You can use the NLA editor to assemble a complex dance from simple actions.



  3. #3
    Member clockmender's Avatar
    Join Date
    Nov 2014
    Location
    East Leicestershire, UK
    Posts
    2,492
    See this thread:

    https://blenderartists.org/forum/sho...ync-Animations

    And this one:

    https://blenderartists.org/forum/sho...ophone-Project

    Then look at my Youtube channel (in my signature at the bottom of this post) at some of the latest vids, then let me know if you want to take this approach further. it requires a MIDI file to animate exactly to the music. I have my Human model tapping one of her feet to the beat now, ready for a later video of the "Clockophone".

    I have written some MIDI Sync nodes as an add-on top Jacques excellent Animation Nodes.

    Cheers, Clock.
    Last edited by clockmender; 21-Nov-17 at 15:21.
    K.I.S.S - a good maxim I think, and Granddads know best! No Website for now TalkTalkBusiness have screwed it up!
    My Youtube Channel (Pretty small just now...)https://www.youtube.com/channel/UCfO...1sCoG0NqZkgaAg



Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •