Fix the build for an INET6 only configuration.
The fix from the last commit is actually needed twice...
MFC after: 1 week