Cancel silc_server_connect_to_router_retry when connecting.