Statistics of Fine Gaussian fluctuations on the Poisson space II: Rescaled kernels, marked processes and geometric $U$-statistics