You might need to add the objects shadow from a shadow catcher instead or render the shot twice (but only for the transition duration), one with the object in it and the other without. Then mix these shots in compositor or the VSE.
I would take the object’s material, and add a Mix shader with a Transparent shader attached. Then you can simply keyframe the mix to fade in the object. The shadow will then naturally fade in as well.