Are my normal maps just wrong or I am expecting too much?

Your question wasn’t silly. But i think it lacks one important point:

  • What for are your assets (usage and application)? and
  • What do you wanna gain in respect to polygons ratio/ saving/ economy?

The usual tricks to fake some details and having less polygons are known here in the forum but we don’t know the circumstances you are dealing with… or you pecise target. As already noted by:

Even used in blender 10 years ago Parallax mapping for Blender Render / Cycles? - #13 by Binary and there are others… using it to render building interoirs for example (one quad no intern geometry)… So baking a displacement map is possible and viewable in blender (and needed for/used by the parallax render process) But another thing is:

  • You already used Substance… and now wanna try Blender (with different addons) …

And our results in Substance were better? The info you give here are somekind of missleading. So the question about you expectations was appropriate. One would suppose you know this reason/benefit and disadvantage of using bump maps and normalmaps for bumping, normal light faking, paralax render or even geometry shader…
(Anyway: if the postings answered your question then mark it solved.)