DO not attach before pf is attached as we borrow locks from there;
do not detach before pf is detached as otherwise we might still be called
for VNETs and thus reference freed memory.

Sponsored by: The FreeBSD Foundation