Turned off all my objects in the blend and viewport is still slow!

On a side note, this node tree can also speed up the viewport animation playback: Way Faster Normal Map Node (for realtime animation playback with tangent space normals)