Tips on object tracking a difficult rotating object?

I’m currently trying to track part of my arm as shown in the picture. It seems I can’t use automatic tracking because too many of the dots go out of frame and are replaced with new ones, so blender fails to keyframe it.

image
I’ve been trying to mess around with “Link empty to track”, and was wondering would it be possible to track rotation with two or three points instead of translation, as right now it only moves left and right while not rotating.
Help is appreciated!