I think you have run into this issue (or similar):
https://blenderartists.org/t/blender-5-alpha-installed-nvidia-driver-has-known-issues/
There was a Nvidia driver version that was Blacklisted due to problems with Wayland and Vulkan.
If it is that then switching from Vulkan to Open GL should fix it.
Also Nvidia released newer driver versions with a fix.
I am now using 580.82.07 and it is fine for me, but I am also using an X server (not Wayland), you say 580 driver but which are the other numbers (580.76.05-4 was bad and maybe some others)?