Remove texture

Is there some way to apply a texture to a object and then remove it selectively in little bits like with a brush or something?