Reference Picture And Size Problem

I am using reference pictures for my current project. I have a front view and a side view and eventually I will need to use a rear view. The problem is when I have modelled based on the side view and then go to the front view, they don’t match up. The scale of the mesh is too small. I have already insured that the images are exact in proportion, size, etc. If I try and scale it up in front view it does it in side view, which makes it too large. So what are my options to fix this?

EDIT: Never mind I figured it out.