Mesh being pushed away by another mesh

Hi all.

Want to make an arrow piercing an apple, so when the arrow hit the first part of the apple, the apple will move to the side.
Perhaps using the collision modifier, although I dont know how exactly