If it’s supposed to be a heightmap, then the algorithm obviously didn’t do a very good job. It would also be an iffy result if the intent was stylization because of all the grey junk floating around.
The second image was the source image, that I generated using cycles,
I took the cycles bake result and passed it through a style transfer of a sheet of greebles
This would be great if someone could code it! wish my python skills were better than beginner level lol!
The method can also be used to upscale low res textures really well using multiple reference images!
See here, this guy did it with minecraft textures and got great results - https://nucl.ai/blog/enhance-pixel-art/
I think devs should look into Neural stuff for blender sooner or later. I guess many tools in the coming years will use this technology. But, there’s a long way to do this. First, you take the best library(tensorflow?) then, you start doing stuff step by step. Style transfer is quite advanced allready, although there are papers how to write this quite easily…
I thought about some kind of animation development, but don’t have relly time for that…
The green one looks like a circuit board. The others would be usefull as generic metal panel textures. Have you tried using the software to combine normal maps or height maps yet? that might produce some interesting results
> The process should complete in 3 to 8 minutes, even with twice the iteration count.
As a node… no, this will never make it into cycles… materials calculations need to take a fraction of a second to compute, rather then minutes… imaging having to wait 3-8 minutes longer per sample then before.
as a comp node… probably not aswell… it would lock up blender and people would complain it doesnt work.
its best to keep this sort of thing as a separate program.
I suppose there could be a neural bake mode? with a progress bar like you get when baking textures.
Then maybe a node that can hold the baked neural transfer images? or the images can be saved and used as normal…
At least then the user will know they have to wait for the process to complete.
I’m guessing it would be a hard job to make an add-on that functioned in that way though…
But then again, it’s just easy enough to make them on seperate programs and import them to blender