Making Smooth Cloth overlay with Cloth Sim?

Hey, everyone. I’m trying to make a skirt front for a skort. The style I want is the kind that looks like a skirt in the front and shorts in the back. So, something like these:


I took a section of the shorts, duplicated and split it, added the section between the legs, pinned the edges I wanted to stay in place (down one side, across the top, and the green box) and started playing with cloth sim locations and settings, with the shorts as a collision body. The skirt will re-attacged to the shorts, eventually be rigged and have physics bodies added so it works in another program. Exporting is also why everything is tris and not quads.

The cloth keeps turning into a rumpled mess when it is near the shorts. When it’s far away, it has a nicer hang to it, lying flat, but doesn’t reflect the shape of the shorts, which would mean I have to edit it into place. Is there a way I could edit it to make it lay flat in cloth sim? Do I need to add extra steps to my process?