Unable to create RKE cluster

Hi Rancher Team.

I have three openstack nodes with Centos. These machines dont have public IP address.
I have added the user(centos which is the ssh user) to docker group
I have the three nodes added to the /etc/hosts so they can communicate.
From my windows I can easily ssh into these hosts.
Example

ssh -i C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem centos@172.24.173.67 docker ps -a

The cluster.yml file

cluster_name: db-rke-cluster1
ingress:
provider: nginx
network:
plugin: calico
nodes:

address: “127.0.0.1”

internal_address: "172.24.173.65"
port: 2222
role: 
  - controlplane
  - worker
  - etcd
ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem"
user: centos

address: “127.0.0.1”

internal_address: "172.24.173.66"
port: 2222
role: 
  - worker
ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem"
user: centos

address: “127.0.0.1”

internal_address: "172.24.173.67"
port: 2222
role: 
  - worker
ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem"
user: centos

services:
etcd:
creation: 6h
retention: 24h
snapshot: true

When I run the rke up command I get the following error :-1:
time=“2020-06-12T12:35:58-07:00” level=info msg=“Running RKE version: v1.1.2”
time=“2020-06-12T12:35:58-07:00” level=info msg=“Initiating Kubernetes cluster”
time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.67]"
time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.66]"
time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.65]"
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.65]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.24/info: Failed to dial ssh using address [172.24.173.65:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.67]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.24/info: Failed to dial ssh using address [172.24.173.67:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.66]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.24/info: Failed to dial ssh using address [172.24.173.66:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.65] from node lists”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.67] from node lists”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.66] from node lists”
time=“2020-06-12T12:35:58-07:00” level=warning msg="[state] can’t fetch legacy cluster state from Kubernetes: Cluster must have at least one etcd plane host: failed to connect to the following etcd host(s) [172.24.173.65]"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating CA kubernetes certificates"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kubernetes API server aggregation layer requestheader client CA certificates"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] GenerateServingCertificate is disabled, checking if there are unused kubelet certificates"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kubernetes API server certificates"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Service account token key"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kube Controller certificates"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kube Scheduler certificates"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kube Proxy certificates"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Node certificate"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating admin certificates and kubeconfig"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kubernetes API server proxy client certificates"
time=“2020-06-12T12:35:59-07:00” level=info msg=“Successfully Deployed state file at [./cluster.rkestate]”
time=“2020-06-12T12:35:59-07:00” level=info msg=“Building Kubernetes cluster”
time=“2020-06-12T12:35:59-07:00” level=fatal msg=“Cluster must have at least one etcd plane host: please specify one or more etcd in cluster config”

What am I doing wrong???

Based on Google its because of the encoding of the key file. How was the key created?

Hi.

Thanks for your reply. The key was created during the time of Openstack VM creation.
I regularly use the .ppk version of it to putty into the VMS.
I am able to run ssh command from cygwin with the exact key.
Do you think the .pem file has some trailing windows characters, clearly RKE cannot parse them???

Sounds identical to https://github.com/hashicorp/packer/issues/2526, we can probably use their solution/workaround if it is the case. Can you manually convert a copy of the key (from BER to DER) and try to use that to confirm that is the issue?

Hi,
Yes will definetely try.
There’s a great link explaining the formats
difference in key formats

However once I do that, I do have another issue that I am currently facing
Now everytime I TRY to run rke remove command or some sort of reset
I keep getting
time=“2020-06-15T11:39:27-07:00” level=fatal msg="Failed to validate cluster: Cluster can’t have duplicate node: "

Once I have corrected the ssh key should I just run the rke up command or do something else to reset. I deleted the state file that got created and when I first
ran the rke up command and got ssh error.

Again thanks a lot for your help.
Will keep you all posted.

You have duplicate address: values in your configuration file. If you don’t have explicit address and public addresses for each node, you can just define address alone.

I see. so I dont have public address for the nodes. In this case should I just use the address field only and no internal_address or just address field with the ip_address of the node.

Thank you,

Got it to work. It was the ssh file, as soon as 1]I converted from .pem file to id_rsa using puttyGen tool (exporting to openssh) format 2] And used address field only with the ip addresses of the openstack vms, I was able to get the cluster installed successfully.

db103475@DB103475-DD /cygdrive/c/RKE
$ rke up --config ./cluster1.yml
time="2020-06-15T13:14:36-07:00" level=info msg="Running RKE version: v1.1.2"
time="2020-06-15T13:14:36-07:00" level=info msg="Initiating Kubernetes cluster"
time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.67]"
time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.65]"
time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.66]"
time="2020-06-15T13:14:36-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:14:36-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:42-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:42-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:42-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.65]"
time="2020-06-15T13:14:42-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:14:42-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:47-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:14:47-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:48-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.66]"
time="2020-06-15T13:14:48-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:14:48-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:53-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:14:53-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:53-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.67]"
time="2020-06-15T13:14:53-07:00" level=info msg="[certificates] Generating CA kubernetes certificates"
time="2020-06-15T13:14:53-07:00" level=info msg="[certificates] Generating Kubernetes API server aggregation layer requestheader client CA certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] GenerateServingCertificate is disabled, checking if there are unused kubelet certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kubernetes API server certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Service account token key"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Controller certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Scheduler certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Proxy certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Node certificate"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating admin certificates and kubeconfig"
time="2020-06-15T13:14:55-07:00" level=info msg="[certificates] Generating Kubernetes API server proxy client certificates"
time="2020-06-15T13:14:55-07:00" level=info msg="[certificates] Generating kube-etcd-172-24-173-65 certificate and key"
time="2020-06-15T13:14:55-07:00" level=info msg="Successfully Deployed state file at [./cluster1.rkestate]"
time="2020-06-15T13:14:55-07:00" level=info msg="Building Kubernetes cluster"
time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.67]"
time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.65]"
time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.66]"
time="2020-06-15T13:14:56-07:00" level=info msg="[network] Deploying port listener containers"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-etcd-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:56-07:00" level=info msg="[network] Successfully started [rke-etcd-port-listener] container on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-cp-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:56-07:00" level=info msg="[network] Successfully started [rke-cp-port-listener] container on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.67]"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.66]"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Port listener containers deployed successfully"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running control plane -> etcd port checks"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running control plane -> worker port checks"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running workers -> control plane port checks"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.67]"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.66]"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[network] Checking KubeAPI port Control Plane hosts"
time="2020-06-15T13:14:58-07:00" level=info msg="[network] Removing port listener containers"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-etcd-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-etcd-port-listener] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-cp-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-cp-port-listener] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:14:58-07:00" level=info msg="[network] Port listener containers removed successfully"
time="2020-06-15T13:14:58-07:00" level=info msg="[certificates] Deploying kubernetes certificates to Cluster nodes"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.67], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.66], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="[reconcile] Rebuilding and updating local kube config"
time="2020-06-15T13:15:03-07:00" level=info msg="Successfully Deployed local admin kubeconfig at [./kube_config_cluster1.yml]"
time="2020-06-15T13:15:04-07:00" level=info msg="[certificates] Successfully deployed kubernetes certificates to Cluster nodes"
time="2020-06-15T13:15:04-07:00" level=info msg="[file-deploy] Deploying file [/etc/kubernetes/audit-policy.yaml] to node [172.24.173.65]"
time="2020-06-15T13:15:04-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:15:04-07:00" level=info msg="Starting container [file-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:05-07:00" level=info msg="Successfully started [file-deployer] container on host [172.24.173.65]"
time="2020-06-15T13:15:05-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:05-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:05-07:00" level=info msg="Container [file-deployer] is still running on host [172.24.173.65]"
time="2020-06-15T13:15:06-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:06-07:00" level=info msg="Removing container [file-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:06-07:00" level=info msg="[remove/file-deployer] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:15:06-07:00" level=info msg="[/etc/kubernetes/audit-policy.yaml] Successfully deployed audit policy file to Cluster control nodes"
time="2020-06-15T13:15:06-07:00" level=info msg="[reconcile] Reconciling cluster state"
time="2020-06-15T13:15:06-07:00" level=info msg="[reconcile] This is newly generated cluster"
time="2020-06-15T13:15:06-07:00" level=info msg="Pre-pulling kubernetes images"
time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.66], try #1"
time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.67], try #1"
time="2020-06-15T13:15:54-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]"
time="2020-06-15T13:15:55-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:15:56-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]"
time="2020-06-15T13:15:56-07:00" level=info msg="Kubernetes images pulled successfully"
time="2020-06-15T13:15:56-07:00" level=info msg="[etcd] Building up etcd plane.."
time="2020-06-15T13:15:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:15:56-07:00" level=info msg="Starting container [etcd-fix-perm] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:57-07:00" level=info msg="Successfully started [etcd-fix-perm] container on host [172.24.173.65]"
time="2020-06-15T13:15:57-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:57-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:57-07:00" level=info msg="Container [etcd-fix-perm] is still running on host [172.24.173.65]"
time="2020-06-15T13:15:58-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:58-07:00" level=info msg="Removing container [etcd-fix-perm] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:58-07:00" level=info msg="[remove/etcd-fix-perm] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:15:58-07:00" level=info msg="Pulling image [rancher/coreos-etcd:v3.4.3-rancher1] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:02-07:00" level=info msg="Image [rancher/coreos-etcd:v3.4.3-rancher1] exists on host [172.24.173.65]"
time="2020-06-15T13:16:02-07:00" level=info msg="Starting container [etcd] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Successfully started [etcd] container on host [172.24.173.65]"
time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Running rolling snapshot container [etcd-snapshot-once] on host [172.24.173.65]"
time="2020-06-15T13:16:02-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:02-07:00" level=info msg="Starting container [etcd-rolling-snapshots] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Successfully started [etcd-rolling-snapshots] container on host [172.24.173.65]"
time="2020-06-15T13:16:07-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:08-07:00" level=info msg="Starting container [rke-bundle-cert] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:08-07:00" level=info msg="[certificates] Successfully started [rke-bundle-cert] container on host [172.24.173.65]"
time="2020-06-15T13:16:08-07:00" level=info msg="Waiting for [rke-bundle-cert] container to exit on host [172.24.173.65]"
time="2020-06-15T13:16:08-07:00" level=info msg="Container [rke-bundle-cert] is still running on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Waiting for [rke-bundle-cert] container to exit on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="[certificates] successfully saved certificate bundle [/opt/rke/etcd-snapshots//pki.bundle.tar.gz] on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Removing container [rke-bundle-cert] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:09-07:00" level=info msg="[etcd] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:09-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="[etcd] Successfully started etcd plane.. Checking etcd cluster health"
time="2020-06-15T13:16:09-07:00" level=info msg="[controlplane] Building up Controller Plane.."
time="2020-06-15T13:16:09-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:10-07:00" level=info msg="Starting container [kube-apiserver] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:10-07:00" level=info msg="[controlplane] Successfully started [kube-apiserver] container on host [172.24.173.65]"
time="2020-06-15T13:16:10-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-apiserver] on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="[healthcheck] service [kube-apiserver] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:18-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:18-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:18-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="Starting container [kube-controller-manager] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:19-07:00" level=info msg="[controlplane] Successfully started [kube-controller-manager] container on host [172.24.173.65]"
time="2020-06-15T13:16:19-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-controller-manager] on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="[healthcheck] service [kube-controller-manager] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:24-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:24-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:24-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="Starting container [kube-scheduler] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:25-07:00" level=info msg="[controlplane] Successfully started [kube-scheduler] container on host [172.24.173.65]"
time="2020-06-15T13:16:25-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-scheduler] on host [172.24.173.65]"
time="2020-06-15T13:16:30-07:00" level=info msg="[healthcheck] service [kube-scheduler] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:30-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:30-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:30-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:30-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:30-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:30-07:00" level=info msg="[controlplane] Successfully started Controller Plane.."
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating rke-job-deployer ServiceAccount"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] rke-job-deployer ServiceAccount created successfully"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating system:node ClusterRoleBinding"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] system:node ClusterRoleBinding created successfully"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating kube-apiserver proxy ClusterRole and ClusterRoleBinding"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] kube-apiserver proxy ClusterRole and ClusterRoleBinding created successfully"
time="2020-06-15T13:16:31-07:00" level=info msg="Successfully Deployed state file at [./cluster1.rkestate]"
time="2020-06-15T13:16:31-07:00" level=info msg="[state] Saving full cluster state to Kubernetes"
time="2020-06-15T13:16:31-07:00" level=info msg="[state] Successfully Saved full cluster state to Kubernetes ConfigMap: full-cluster-state"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Building up Worker Plane.."
time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="[sidekick] Sidekick container already created on host [172.24.173.65]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [nginx-proxy] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.65]"
time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.65]"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [nginx-proxy] container on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [nginx-proxy] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [nginx-proxy] container on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.67]"
time="2020-06-15T13:16:36-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:36-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:36-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:36-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:36-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.66] is healthy"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.67] is healthy"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.66] is healthy"
time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.67] is healthy"
time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started Worker Plane.."
time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:16:39-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.65]"
time="2020-06-15T13:16:39-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:39-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:39-07:00" level=info msg="[sync] Syncing nodes Labels and Taints"
time="2020-06-15T13:16:39-07:00" level=info msg="[sync] Successfully synced nodes Labels and Taints"
time="2020-06-15T13:16:39-07:00" level=info msg="[network] Setting up network plugin: calico"
time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-network-plugin to Kubernetes"
time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-network-plugin to Kubernetes"
time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Executing deploy job rke-network-plugin"
time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Setting up coredns"
time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-coredns-addon to Kubernetes"
time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-coredns-addon to Kubernetes"
time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Executing deploy job rke-coredns-addon"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] CoreDNS deployed successfully"
time="2020-06-15T13:16:49-07:00" level=info msg="[dns] DNS provider coredns deployed successfully"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Setting up Metrics Server"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-metrics-addon to Kubernetes"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-metrics-addon to Kubernetes"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Executing deploy job rke-metrics-addon"
time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Metrics Server deployed successfully"
time="2020-06-15T13:16:54-07:00" level=info msg="[ingress] Setting up nginx ingress controller"
time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-ingress-controller to Kubernetes"
time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-ingress-controller to Kubernetes"
time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Executing deploy job rke-ingress-controller"
time="2020-06-15T13:17:00-07:00" level=info msg="[ingress] ingress controller nginx deployed successfully"
time="2020-06-15T13:17:00-07:00" level=info msg="[addons] Setting up user addons"
time="2020-06-15T13:17:00-07:00" level=info msg="[addons] no user addons defined"
time="2020-06-15T13:17:00-07:00" level=info msg="Finished building Kubernetes cluster successfully"

Thank you