Lightmap Pack Problem

Hello Everyone,

I’ve recently finished a low poly model of a house. I used insets for the windows and doors rather than adding too many unnecessary vertices with loop cuts.

I’m trying to use lightmap pack in the uv unwrap options for baking all the textures to one map. However, the textures on the four faces around each inset get crazy distorted when I apply the baked texture. Also, it’s only distorted in object mode. In edit it looks fine. Smartmap pack works fine, but doesn’t utilize as many pixels as I’d like. Even after Averaging island scale and packing islands it only uses 60%.

I’d appreciate any tips you guys might have. Thanks!