Cropping physics settling from animations

I recently made an animation consisting of a rigged character as well as silk cloth physics for her hair, robe sleeves, and skirt. It seems that I cannot cut out the frame span of the physics settling (completely) from the animations I made. The best I was able to do was move the keyframes forward a bit and increase the start frame. However, no matter how far along I move my keyframes and bump the start frame, There’s always a very annoying sort of twitch from the cloth physics, which should’ve settled 20-40 frames into the animation. Is there a way to settle physics pre-animation or something?

The rendered GIF is below. Yes, I’m aware that there’s clipping and holes in the shoulders, but as I can’t do character modeling that well and a friend supplied this, beggars can’t be choosers.