You’re creating concave quads like that. Everything gets triangulated for drawing on the screen (and rendering) and a quad has two triangulation options:
Top row: triangulation options for convex and concave quads
Don’t make concave polygons, otherwise you would have to triangulate them yourself to have the control over where the edges go.