Animating a ball with a force makes it jump back and forth

Hi, I’m making a circuit with a ball. Since I wanted an accurate rotation and bouncines at some other points I decided to go with physics simulation and a force field instead of complex rig with animation nodes and quaternions hell that I don’t even know about.

As you can see, sometimes it goes before, and sometimes after. At some point the simulation was not perfect but decent, but lights messed up and I had to reimport into a new file but that’s another topic.

Do you think is possible to get a good timing or should I use something else like wind? I attach the file in case you want to experiment with it.

ball.blend (3.6 MB)

In the force I’ve set I set flow to 1, this makes the ball to stay away all the time with a more regular distance.
I also deleted one middle key of the force position but the problem is solved by the flow setting.