ifconfig_netlink.c: MFC: optimise non-listing case

This change produced by melifaro and the commit is concerted with him
as he is pretty busy IRL these days.

The change restores performance of /sbin/ifconfig utility
for non-listing case after it switched from rtsock to netlink(4) API
in FreeBSD 14+.

PR: 287872

(cherry picked from commit b1b17432aa1be670564161232d110461a5dde4ce)