Texture onto wall in Cycles

I’ve used crazybump to make my stone wall texture look more realistic, as well as the displacement modifier to make it look 3D. I can’t seem to figure out how to place it onto, say, a building - because when I do so, the image returns to being flat. How do I keep it 3D and also place it around the building so that it looks random?