I’m not really sure what you’re asking about. Your scene looks nice. The planet looks strange, but it’s an alien planet. What’s the actual problem? Lighting ? Shading? Modeling?
The larger molten planet (in the photo) doesn’t have smooth lighting, it’s very bumpy the way the suns light is being reflected and I’m not sure why it looks like that and I want to fix it.
look up the shadow terminator problem. i think newer cycles versions have a compensation for it. subdividing the sphere more helps too.
What light do you use ?
If it is a sun light, you need to use a very large angle if you want smooth shadow.
For modeling you can use auto smooth on your objects and bevel modifier.
You can fix this by going to the object properties tab, if you have chosen Cycles to render, then there will be a shading section with a shadow terminator value . Its zero by default, increase it to get rid of these artifacts.
A bevel modifier on a sphere?