Let sockaddr_storage_to_ip() assert that the address family is AF_INET or AF_INET6