artifacts on blurry reflective surface when using HDR

I use a HDR image for reflection, below is my material settings and the render result. It looks like the specular highlight areas became kinda pixelated/noisy, how can I get rid of them or smooth them out.
This only occur when using HDR for reflection, if I used another format, say JPG, the noise’s gone. What’s the problem anyway ?