Normal map made in blender causing weird shadows on model

I have been working on a model of an apartment and got to baking my normal maps but for some reason whenever i bake the normal’s and apply it to my model i get really bad shadows around certain parts of the model. I decided to put it into the unity engine as well as the unreal engine but i get the same effect. Its very noticeable around the door frames.

Unreal Engine:

Normal Map:

Blender File: