Mirror modifier not working

I am trying to grab two vertices on my model and move them. It mirrors the grab, however it creates another set of vertices inward (as well as outward) that are unwanted. How do I fix this problem?

How many axis are you mirroring? and do you have an image of this for us to look at?