Basically, how would I go about making those oddly shaped windows?
I have tried Knife Project and Boolean but I dont know how to make
it look so clean
Model the hull without any doors or windows in it then with shrinkwrap modifier you model your final hull over it.
This video is a great example of the technique: