It is well worth looking into how to make materials. For house window glass you can get away with simply mixing a glossy shader with a transparent shader. For more complex materials with image textures (for bricks stone etc) you can check this thread there are many free resources:
(NEW blog!) List of free texture sites
You will still have to know how to plug the different images in the shader editor so look up basic texture node tuts.