Here’s the problem, the moment I try use the lattice modifier it immediately deforms the grease pencil stroke. I played around with the object origins, but that didn’t help much.
Found the problem, I must have scaled the lattice to that size while in edit mode, should’ve scaled in object mode. I don’t know how to reverse it though, so i started over.