Move the forwarded-connect-retries handling into a shiny new connect_to()