Time Remapping doesnt render all frames. Only the initial frames? But using output nodes it works?!

So I have a project where I set time remapping from 100 frames old to 200 frames new (.5x speed)
The animation is of a character walking on a rooftop with leaves blowing using particles and physics.
The problem I’m facing is that with everything else set to Holdout the character renders fine, all 700 frames (original frames are 350)
But when I hide the character to render the background, only the initial 350 frames render without applying the time remap.
If I use composition nodes to render the animation it renders all 700 frames, but after frame 350 they’re duplicates.
Why is this happening?