vfs: slightly rework vn_rlimit_fsize
(cherry picked from commit 478c52f1e3654213c7d79096a2bc7f908e0b501d)