Normal map seems inverted when lit from other angles

I was experimenting with normal maps on a curved surface, and noticed that it looks fine from one angle, but wrong from other angles. Is this just how it works, or is there a way to fix it?


here it seems fine.


looks inverted here.


the tiles pop in, instead of out, but only on the horizontal surface.

blenders y is inverted

It seems like I was able to solve this issue by flipping the normals.