Rigid body simulation different when replayed, 2.79

Hi all,

I’m having some issues with the rigid body simulation.
It all looks good when the simulation is being calculated but when I replay the rigid body starts jittering in a weird way. I’m using the mesh shape for collisions but the problem persists even if I change to convex hull. Scale is applied, mass in center weight, steps per sec and solver a bit higher than default but nothing changes when I mess around there anyway. I don’t know any other settings that might be relevant.
Anyone experienced anything like this before?

Is the simulation baked?

It bakes with the jittering.