Misaglined Texture when Baking

I’ve run into the following problem when baking. The broken line in the image is supposed to be straight. The UV is aligned to pixel and everything else is fine. I cannot imagine what the problem is. Any ideas of how I can fix the issue?

http://i.gyazo.com/2111f045d3c81db16c5ead1ac2fc8b1a.png

Also here is how the UV map looks. It does’t seem to happen because of a face edge or anything like that. I am perplexed.

http://i.gyazo.com/36231a1882cfa3d9986d28e647953e6c.png