IK bone moves away from mesh

Hi i have rigged this model and the ik bone is not stuck with the mest whenever i move it the mesh moves (which is good) but the ik bone moves separately. You could see in the picture the big block should be on the small green one. Is this supposed to happen? if not how can i fix this problem.

Thanks in advance :slight_smile: