GPU initialization 4 times slower

Hi gang!

With Blender 2.92 I feel like my 2 GPU’s now take 4 times longer to initialize a scene, as compared to my CPU, haha.

This can’t be right… I am doing something wrong.
Any ideas on how to make rendering with GPU great again 2021 ?

Any help is much appreciated