I don’t really understand the problem, since the region marked in the picture does not seem dense at all.
I suppose what you’re seeing is similar to this:
The scale input is just a factor for the input vector. This has barely any effect when close to the origin (0,0,0), but has a stronger effect further away.
Also, I’m not sure how well voronoi works with variable scale. Did you try using something simpler like the wave texture for testing?