Bump map texture paint - performance issue

I have a texture 4096x4096 32bit Float connected through Bump node to Normal socket of Principled BSDF shader.
I tried to paint in LookDev mode with a 16 bit 2048x2048 alfa brush and Blender slows down as much as it’s impossible to work this way. It’s most visible when Stroke is set to Anchored and I scale the brush quite much. In such case Blender consumes ~90% of CPU for several seconds and becomes unresponsive (Intel i9-9900K, Blende 2.81 on Linux).
Do I do something wrong, like texture/brush resolution setup, or it’s common issue?
How do you guys workaround this?

It’s a common issue. What helps to a certain degree is to enable paint mask (with only a small part of the mesh selected). The issue annoys me like hell, also. If possible, I paint I in the image viewer / UV editor instead.

Ehm, what I forgot, disabling Options->Occlude also helps a lot. With a Paint Mask, it often isn’t necessary to have that on.

Thank you! Will check it out.