Issue with animating displacement

I’m having problem with animating displacement. In the video below, few areas where the sides of extrusions are waving, flickering, and jittering. Anyone knows how to solved this issue?