Moving the plane does not solve the problem, it seems that the horizontal line will always align with the horizontal line in the hdri.
I have been searching for other Sky HDRI, but it seems to be a common practice that the horizontal line is in the middle of the image, https://hdri-skies.com/, https://polyhaven.com/, https://www.ronenbekerman.com/
The images below are typical,
