Background image won't orientate with object

I am a beginner with blender and I have set up three images for templates. My problem is that my top view for the object is going left to right, while the photo is orientated up and down. And I have the same problem with my front view. My photo is front while the object is facing back. When I try to rotate the object, to corrrect orientation, the photo dissapears. Is there a way around this without flipping the images in a photo program? Any help would be appriciated.

Try ctr-1, ctrl-3, etc. to get the opposite view of your object with your reference in view.