oh, I forgot one thing: of course I tried animating the “animation” checkbox at the rigid body type settings. The problem is that I can’t copy those settings from the active shard to the other shards. And I’m too lazy to individually keyframe every single shard. 
Here’s a blendfile to show what I mean.