I have installed rancher on vsphere with 3 node network. Now I am trying to create downstream k8s cluster in vsphere network. The vmspehere has been spined and then i see bunch of errors related to docker in rancher provisioning logs. I went to one of node and run docker ps, i notice the rancher/agent is restarting over and over again/ every 10 to 20 seconds.
[INFO ] Initiating Kubernetes cluster
[INFO ] Successfully Deployed state file at [management-state/rke/rke-2400193475/cluster.rkestate]
[INFO ] Building Kubernetes cluster
[INFO ] [dialer] Setup tunnel for host [10.1.21.242]
[INFO ] [dialer] Setup tunnel for host [10.1.21.161]
[INFO ] [dialer] Setup tunnel for host [10.1.21.244]
[ERROR] Failed to set up SSH tunneling for host [10.1.21.161]: Can't retrieve Docker Info: error during connect: Get "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/info": can not build dialer to [c-bjxdf:m-v8949]
[ERROR] Failed to set up SSH tunneling for host [10.1.21.244]: Can't retrieve Docker Info: error during connect: Get "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/info": can not build dialer to [c-bjxdf:m-qpgwd]
[ERROR] Failed to set up SSH tunneling for host [10.1.21.242]: Can't retrieve Docker Info: error during connect: Get "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/info": can not build dialer to [c-bjxdf:m-xpxlx]
[ERROR] Removing host [10.1.21.161] from node lists
[ERROR] Removing host [10.1.21.244] from node lists
[ERROR] Removing host [10.1.21.242] from node lists
[ERROR] Cluster must have at least one etcd plane host: failed to connect to the following etcd host(s) [10.1.21.161]
[INFO ] Initiating Kubernetes cluster
[INFO ] Successfully Deployed state file at [management-state/rke/rke-390633278/cluster.rkestate]
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
66b6d24ce010 rancher/rancher-agent:v2.6.9 "run.sh" 17 seconds ago Restarting (1) Less than a second ago pedantic_lalande
Provisioning
Provisioner: RKE
Machine Provider: VMware vSphere
Kubernetes Version: v1.24.4-rancher1-1
Machine Pools: 1
Machines: 3
I am not sure whats going on. There is any settings for rancher/agent ? Also i am using ubuntu 20.04
Thanks,
h