Camera parented to a bone, when I move the camera with shift + f entire rig moves

So basically if I move the camera with either shift + f or locking camera to view it moves the parent object too. If I right click the camera and move it it does not, it makes it harder to get the kind of shots I am looking for.

I am curious if anyone else has this happen and if there is a setting or workaround.