2 things. First, I don’t think what you have there will work like you think it will because you would want the image for the pattern to be the factor to choose between the clear glass and the frosted glass. What you have now looks like the image is influencing the color of the glass.
Second, frosted glass has a translucent component. I recently was experimenting with a frosted glass myself, and finally started getting good results when I mixed a glass shader with a translucent shader.
Here’s a couple of examples of this set up in action.
If I was going to do a pattern, like you are wanting to do, I would have that pattern in a black and white image that I would use as a factor of a mix shader to choose between a glass shader and the frosted glass group.