Stray vertex after baking normals?

Hello all! I am new to this forum and also new to Blender. I have done some tutorials, mostly Blender Guru’s, and I got stuck on his Anvil tutorial when you create normals.

When I got the normal I get this chaotic mess, and when applied to the lower poly model it wraps around the model and looks horrendous and I have been googling for a couple days but cannot find anything with the same problem. I was later told by a friend he thought it might be a stray vertex, but couldn’t tell more.

I hope you guys will be able to help me with this, since i see no way of moving forward with this.