Yes, there is additional information that is required for the denoising. Right now, the input consists of:
- Pass you want to denoise (and variance)
- Normal (and variance)
- Pass embedding (like a flag)
All the recent AI based denoisers are also using albedo/color as additional input. I implemented the option to use it as input as well. So far, I did not see benefits in the training, which is kind of surprising. It might be that I need to train longer to notice a difference.
This project could be relatively easily modified and used for other renderers as well. It would be required to create all the training data for every renderer at the moment. Theoretically, this could be improved, but that’s not going to be my focus for now.