Make Video Clip follow track

I’m looking for a way to make a video clip in the video sequence editor follow a track from another clip. I have an effect shot on a black background that I want to screen over a background shot, and I want to tie it to a specific point. I tried to parent the video clip to a tracker, but it doesn’t look like this can be done.

I don’t have enough trackable points to get a decent camera track on the background video, so I can’t go that route by using the effect video as a texture on a shadeless plane; that also seems like a lot of overhead work for a simple effect. I also can’t do a plane track because of the nature of the shot.

Does anyone have an idea of how I can do this? Thanks!