If forwarded-connect-retries is set, only retry if the we are actually forwarding...