Why can't I use a color channel from a procedurally generated Normal map as Displacement Height?

Why can’t I use a color channel from a procedurally generated Normal map as Displacement Height but I can use one from an image based normal map?

xp16 procedural normal color cannot be used as displacement height.blend (1.8 MB) :blender_logo_64_png: 5.1.2

AFAIK, displacement is calculated before the render, and at that time normals are not used at all, so any calculation that uses normals will fail.