To experiment with normals, I always use sharp glossy node to easier spot if I agree with what is happening.
Normal map node takes a normal texture, you know, mid blue etc. Do you get mid blues out of the previous nodes going into that? Does it improve if you simply bypass the normal map node?
Without being able to test with a shared project, I’m just guessing here.