Do not attempt to load the kernel module when checking if an interface exists.

This would cause pseudo network modules to be reloaded again when trying to
unload the first time if any cloned interfaces exist.

MFC after: 2 weeks