Baking of Follow Path reacts weird (Jump off from the original path)


I am doing a 2D GP animation of a pencil writing a letter.

I made a stroke, converted it to curve, parented the pen to an empty and a follow path constrains on the empty for the curve…

I struggled but it is working fine now…

BUT baking is reacting weird, I do get the keyframes (visual keying) but the baked animation “springs” away from the curve…l It is still doing the motion but not over the curve…

I suspect a origin/offset thing but can’t figure it out on my own…

I am using blender 2.91



Did you clear constraints?

No I did not and it worked!!

Big thanks!