We shouldn't really hit an actually-unknown family unless something
has gone awry on a kernel built without IPv6 support, but one can hit
family == 0 in the wild with valid configurations. Add a new DEBUG
message to call out that scenario specifically, and lay a breadcrumb in
comments for anyone that might be investigating that.
While we're here, just load the remote address family once and use that
in 'all' the places. The send path doesn't require the endpoint lock,
naturally, so it's more satisfying to confirm that we're loading it
once and consistently using the same family from start to finish.