Make gizmo ignore the 3D view

Is there a way of making the drag in the center area of the move gizmo (or anywhere else in the screen that’s not the gizmo arrows) transform using last used axis or the grid plane, instead of the screen plane?

Using the screen plane seems just useless.