Cloth Simulation Render time

I’ve been trying to use the cloth simulation to make it look more realistic, when I have the thing set on frame 1 it takes 12 minutes to render but whenever I try to render an image out at any other frame it says its going to take 100’s of hours. I’ve tried so many different things already but I can’t find anything on why its taking so long or how to fix it. Is there any way to fix this?

Cloth sims shouldn’t be adding to your render times.

Make sure you are baking your sims before rendering your animation.

Set up your simulation
Bake it
Render frame/animation

I did that and it did reduce the time some but I’m still having the same issue like its still taking less than 15 minutes for the first frame but hours and hours for any other frame , is there any other thing that I might’ve not clicked on a cloth sim that would cause this issue?

Sorry, of the top of my head I can’t think of any reason a baked cloth sim might slow a render down.

it ends up if you add a subdivision surface modifier prior to the cloth sim then it causes the issue but if you just put it after its all good