Looks incredible!
Attachments
MatcapLivePaintBR.blend (765 KB)
this is amazing.
looks like a fancy matcap
Painted lighting is amazing!!
But I just thought, could their algorythm be used for better noise reduction? That is more useful edge discrimination, I wonder if @lukasstockner97 knows 
+1 to that , you can tell what is specular vs firefly vs diffuse!
The mapping is a lot smarter than matcaps though. Matcaps are only dependent on an object’s normals (as far as I’m aware), whereas this technology considers normals, lighting, shadows, etc. to achieve the final look.
Results look stunning indeed and pretty much fast (even tho it’s just an experiment).
My child mind is in overclock with “My God! I could do this, and this and even this. Give it to meeee”
I’d like to see more about the workflow to understand what production software would be suitable for such feature… unfortunately in years I suppose.
Hmm… patent pending. :rolleyes:
3/7 Adobe researchers, what did you expect? XD
I have same feeling. I would like to know if it can handle several sources of light.
What happens to a character enlightened by a natural light and artificial ones at same time ?
left is the reference and right is the result:
suzanne getting stylized:
And here is realtime painting:
Attachments
What did you use for this?
Blender compositor,I will share how I did it in a while,I am still working on it.
If you paint each light behavior separately and then composite these channels together (not just blending but using smart masks) you can have multiple light sources, also all kinds of layered shading.
Its like having each light in a different AOV, thats good because it gives you the ability to alter it drastically in comp if necessary.
But without a demo showing it : it is hard to believe that if blending is not painted and previewed by user ; it would not be ugly.
So, does it make sense to produce theses passes if you have a hard work to do in compositing anyways ?
Excellent development, hopefully the algorithms and process can be duplicated in Open Source software, like Blender. It is a fascinating and potentially very creative strategy. I took a look at the blend file posted and will need to research more to make sense, but it is a start in the right direction. More sharing of others efforts will be appreciated.
d’oh delete plz.
Knew I saw something like this before. https://wiki.blender.org/index.php/File:SawShark_Sketch.zip
Again not the exact technique of StyLit, but the varied shading patches are dynamically mapped to object illumination.
On the lighting tip, one could live paint HDR / EXR / environment maps using a setup similar to that provided above.
Demo available at http://stylit.org/