Results 1 to 2 of 2
  1. #1
    Member Aschenstern's Avatar
    Join Date
    Feb 2017
    Location
    Germany
    Posts
    18

    Animation - Music Sync

    Hello fellow blenders,

    I know this question has been probably asked a ton of times. But the thing is : even after soing some extent research i didnt really find a good solution so i wanted to ask you guys, maybe i misunderstood something.

    So i have prepared some scenes and own rigged models to do a music video. Basically i have a song and i want to animate the models to it. The tricky part is: i want them to syn exactly to the music/beat.
    For example : lip sync for singing but also mathed movements for example hand clapping etc.

    I tried using the audio scrub method. But for me it didnt really work out : even with waveforms and scrubbing i cant really make our any word sang in the song , not even speaking about my animation being syncronised with the music.

    So , does anyone know a good way to do it? Maybe i misunderstood something?
    Because i cant imagine how to do a good synced animation by using such methods.

    Thank you so much!



  2. #2
    Member Mousy's Avatar
    Join Date
    Jan 2016
    Location
    Ufa
    Posts
    7
    Use pose library for reusable set of phoneme poses and use them. It is extremely difficult to separate voice from music for automation. This requires a well-trained neural network. Therefore the animation of singing should be done manually. It's difficult, but it's possible.

    For animation of dance, you can record movement of some bones with the mouse, then smooth or simplify curves, then manually do adjustments, focusing on the recorded movements of the parts of the rig

    You can use the NLA editor to assemble a complex dance from simple actions.



Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •