Unable to create RKE cluster

Rancher 2.x
1

Hi Rancher Team.

I have three openstack nodes with Centos. These machines dont have public IP address.
I have added the user(centos which is the ssh user) to docker group
I have the three nodes added to the /etc/hosts so they can communicate.
From my windows I can easily ssh into these hosts.
Example

ssh -i C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem centos@172.24.173.67 docker ps -a

The cluster.yml file

cluster_name: db-rke-cluster1
ingress:
provider: nginx
network:
plugin: calico
nodes:

address: “127.0.0.1”

internal_address: "172.24.173.65"
port: 2222
role: 
  - controlplane
  - worker
  - etcd
ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem"
user: centos

address: “127.0.0.1”

internal_address: "172.24.173.66"
port: 2222
role: 
  - worker
ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem"
user: centos

address: “127.0.0.1”

internal_address: "172.24.173.67"
port: 2222
role: 
  - worker
ssh_key_path: "C:/EnterprisePlatform/openstackmlkeys/deepali-kube-keypair.pem"
user: centos

services:
etcd:
creation: 6h
retention: 24h
snapshot: true

When I run the rke up command I get the following error :-1:
time=“2020-06-12T12:35:58-07:00” level=info msg=“Running RKE version: v1.1.2”
time=“2020-06-12T12:35:58-07:00” level=info msg=“Initiating Kubernetes cluster”
time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.67]"
time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.66]"
time=“2020-06-12T12:35:58-07:00” level=info msg="[dialer] Setup tunnel for host [172.24.173.65]"
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.65]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.24/info: Failed to dial ssh using address [172.24.173.65:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.67]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.24/info: Failed to dial ssh using address [172.24.173.67:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Failed to set up SSH tunneling for host [172.24.173.66]: Can’t retrieve Docker Info: error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.24/info: Failed to dial ssh using address [172.24.173.66:2222]: Error configuring SSH: asn1: structure error: superfluous leading zeros in length”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.65] from node lists”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.67] from node lists”
time=“2020-06-12T12:35:58-07:00” level=warning msg=“Removing host [172.24.173.66] from node lists”
time=“2020-06-12T12:35:58-07:00” level=warning msg="[state] can’t fetch legacy cluster state from Kubernetes: Cluster must have at least one etcd plane host: failed to connect to the following etcd host(s) [172.24.173.65]"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating CA kubernetes certificates"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kubernetes API server aggregation layer requestheader client CA certificates"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] GenerateServingCertificate is disabled, checking if there are unused kubelet certificates"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kubernetes API server certificates"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Service account token key"
time=“2020-06-12T12:35:58-07:00” level=info msg="[certificates] Generating Kube Controller certificates"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kube Scheduler certificates"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kube Proxy certificates"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Node certificate"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating admin certificates and kubeconfig"
time=“2020-06-12T12:35:59-07:00” level=info msg="[certificates] Generating Kubernetes API server proxy client certificates"
time=“2020-06-12T12:35:59-07:00” level=info msg=“Successfully Deployed state file at [./cluster.rkestate]”
time=“2020-06-12T12:35:59-07:00” level=info msg=“Building Kubernetes cluster”
time=“2020-06-12T12:35:59-07:00” level=fatal msg=“Cluster must have at least one etcd plane host: please specify one or more etcd in cluster config”

What am I doing wrong???

2

Based on Google its because of the encoding of the key file. How was the key created?

3

Hi.

Thanks for your reply. The key was created during the time of Openstack VM creation.
I regularly use the .ppk version of it to putty into the VMS.
I am able to run ssh command from cygwin with the exact key.
Do you think the .pem file has some trailing windows characters, clearly RKE cannot parse them???

4

Sounds identical to https://github.com/hashicorp/packer/issues/2526, we can probably use their solution/workaround if it is the case. Can you manually convert a copy of the key (from BER to DER) and try to use that to confirm that is the issue?

5

Hi,
Yes will definetely try.
There’s a great link explaining the formats
difference in key formats

However once I do that, I do have another issue that I am currently facing
Now everytime I TRY to run rke remove command or some sort of reset
I keep getting
time=“2020-06-15T11:39:27-07:00” level=fatal msg="Failed to validate cluster: Cluster can’t have duplicate node: "

Once I have corrected the ssh key should I just run the rke up command or do something else to reset. I deleted the state file that got created and when I first
ran the rke up command and got ssh error.

Again thanks a lot for your help.
Will keep you all posted.

6

You have duplicate address: values in your configuration file. If you don’t have explicit address and public addresses for each node, you can just define address alone.

7

I see. so I dont have public address for the nodes. In this case should I just use the address field only and no internal_address or just address field with the ip_address of the node.

Thank you,

8

Got it to work. It was the ssh file, as soon as 1]I converted from .pem file to id_rsa using puttyGen tool (exporting to openssh) format 2] And used address field only with the ip addresses of the openstack vms, I was able to get the cluster installed successfully.

db103475@DB103475-DD /cygdrive/c/RKE
$ rke up --config ./cluster1.yml
time="2020-06-15T13:14:36-07:00" level=info msg="Running RKE version: v1.1.2"
time="2020-06-15T13:14:36-07:00" level=info msg="Initiating Kubernetes cluster"
time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.67]"
time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.65]"
time="2020-06-15T13:14:36-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.66]"
time="2020-06-15T13:14:36-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:14:36-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:42-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:42-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:42-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.65]"
time="2020-06-15T13:14:42-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:14:42-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:47-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:14:47-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:48-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.66]"
time="2020-06-15T13:14:48-07:00" level=info msg="Checking if container [cluster-state-deployer] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:14:48-07:00" level=info msg="Pulling image [rancher/rke-tools:v0.1.56] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:53-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:14:53-07:00" level=info msg="Starting container [cluster-state-deployer] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:53-07:00" level=info msg="[state] Successfully started [cluster-state-deployer] container on host [172.24.173.67]"
time="2020-06-15T13:14:53-07:00" level=info msg="[certificates] Generating CA kubernetes certificates"
time="2020-06-15T13:14:53-07:00" level=info msg="[certificates] Generating Kubernetes API server aggregation layer requestheader client CA certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] GenerateServingCertificate is disabled, checking if there are unused kubelet certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kubernetes API server certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Service account token key"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Controller certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Scheduler certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Kube Proxy certificates"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating Node certificate"
time="2020-06-15T13:14:54-07:00" level=info msg="[certificates] Generating admin certificates and kubeconfig"
time="2020-06-15T13:14:55-07:00" level=info msg="[certificates] Generating Kubernetes API server proxy client certificates"
time="2020-06-15T13:14:55-07:00" level=info msg="[certificates] Generating kube-etcd-172-24-173-65 certificate and key"
time="2020-06-15T13:14:55-07:00" level=info msg="Successfully Deployed state file at [./cluster1.rkestate]"
time="2020-06-15T13:14:55-07:00" level=info msg="Building Kubernetes cluster"
time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.67]"
time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.65]"
time="2020-06-15T13:14:55-07:00" level=info msg="[dialer] Setup tunnel for host [172.24.173.66]"
time="2020-06-15T13:14:56-07:00" level=info msg="[network] Deploying port listener containers"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-etcd-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:56-07:00" level=info msg="[network] Successfully started [rke-etcd-port-listener] container on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-cp-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:56-07:00" level=info msg="[network] Successfully started [rke-cp-port-listener] container on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:14:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:56-07:00" level=info msg="Starting container [rke-worker-port-listener] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.67]"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-worker-port-listener] container on host [172.24.173.66]"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Port listener containers deployed successfully"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running control plane -> etcd port checks"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running control plane -> worker port checks"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Running workers -> control plane port checks"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:14:57-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="Starting container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.67]"
time="2020-06-15T13:14:57-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[network] Successfully started [rke-port-checker] container on host [172.24.173.66]"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-port-checker] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[network] Checking KubeAPI port Control Plane hosts"
time="2020-06-15T13:14:58-07:00" level=info msg="[network] Removing port listener containers"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-etcd-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-etcd-port-listener] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-cp-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-cp-port-listener] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Removing container [rke-worker-port-listener] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:14:58-07:00" level=info msg="[remove/rke-worker-port-listener] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:14:58-07:00" level=info msg="[network] Port listener containers removed successfully"
time="2020-06-15T13:14:58-07:00" level=info msg="[certificates] Deploying kubernetes certificates to Cluster nodes"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:14:58-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.66], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Starting container [cert-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:14:58-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.67], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Checking if container [cert-deployer] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.66], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="Removing container [cert-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:03-07:00" level=info msg="[reconcile] Rebuilding and updating local kube config"
time="2020-06-15T13:15:03-07:00" level=info msg="Successfully Deployed local admin kubeconfig at [./kube_config_cluster1.yml]"
time="2020-06-15T13:15:04-07:00" level=info msg="[certificates] Successfully deployed kubernetes certificates to Cluster nodes"
time="2020-06-15T13:15:04-07:00" level=info msg="[file-deploy] Deploying file [/etc/kubernetes/audit-policy.yaml] to node [172.24.173.65]"
time="2020-06-15T13:15:04-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:15:04-07:00" level=info msg="Starting container [file-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:05-07:00" level=info msg="Successfully started [file-deployer] container on host [172.24.173.65]"
time="2020-06-15T13:15:05-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:05-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:05-07:00" level=info msg="Container [file-deployer] is still running on host [172.24.173.65]"
time="2020-06-15T13:15:06-07:00" level=info msg="Waiting for [file-deployer] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:06-07:00" level=info msg="Removing container [file-deployer] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:06-07:00" level=info msg="[remove/file-deployer] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:15:06-07:00" level=info msg="[/etc/kubernetes/audit-policy.yaml] Successfully deployed audit policy file to Cluster control nodes"
time="2020-06-15T13:15:06-07:00" level=info msg="[reconcile] Reconciling cluster state"
time="2020-06-15T13:15:06-07:00" level=info msg="[reconcile] This is newly generated cluster"
time="2020-06-15T13:15:06-07:00" level=info msg="Pre-pulling kubernetes images"
time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.66], try #1"
time="2020-06-15T13:15:06-07:00" level=info msg="Pulling image [rancher/hyperkube:v1.17.6-rancher2] on host [172.24.173.67], try #1"
time="2020-06-15T13:15:54-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]"
time="2020-06-15T13:15:55-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:15:56-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]"
time="2020-06-15T13:15:56-07:00" level=info msg="Kubernetes images pulled successfully"
time="2020-06-15T13:15:56-07:00" level=info msg="[etcd] Building up etcd plane.."
time="2020-06-15T13:15:56-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:15:56-07:00" level=info msg="Starting container [etcd-fix-perm] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:57-07:00" level=info msg="Successfully started [etcd-fix-perm] container on host [172.24.173.65]"
time="2020-06-15T13:15:57-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:57-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:57-07:00" level=info msg="Container [etcd-fix-perm] is still running on host [172.24.173.65]"
time="2020-06-15T13:15:58-07:00" level=info msg="Waiting for [etcd-fix-perm] container to exit on host [172.24.173.65]"
time="2020-06-15T13:15:58-07:00" level=info msg="Removing container [etcd-fix-perm] on host [172.24.173.65], try #1"
time="2020-06-15T13:15:58-07:00" level=info msg="[remove/etcd-fix-perm] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:15:58-07:00" level=info msg="Pulling image [rancher/coreos-etcd:v3.4.3-rancher1] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:02-07:00" level=info msg="Image [rancher/coreos-etcd:v3.4.3-rancher1] exists on host [172.24.173.65]"
time="2020-06-15T13:16:02-07:00" level=info msg="Starting container [etcd] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Successfully started [etcd] container on host [172.24.173.65]"
time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Running rolling snapshot container [etcd-snapshot-once] on host [172.24.173.65]"
time="2020-06-15T13:16:02-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:02-07:00" level=info msg="Starting container [etcd-rolling-snapshots] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:02-07:00" level=info msg="[etcd] Successfully started [etcd-rolling-snapshots] container on host [172.24.173.65]"
time="2020-06-15T13:16:07-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:08-07:00" level=info msg="Starting container [rke-bundle-cert] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:08-07:00" level=info msg="[certificates] Successfully started [rke-bundle-cert] container on host [172.24.173.65]"
time="2020-06-15T13:16:08-07:00" level=info msg="Waiting for [rke-bundle-cert] container to exit on host [172.24.173.65]"
time="2020-06-15T13:16:08-07:00" level=info msg="Container [rke-bundle-cert] is still running on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Waiting for [rke-bundle-cert] container to exit on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="[certificates] successfully saved certificate bundle [/opt/rke/etcd-snapshots//pki.bundle.tar.gz] on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Removing container [rke-bundle-cert] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:09-07:00" level=info msg="[etcd] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:09-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="[etcd] Successfully started etcd plane.. Checking etcd cluster health"
time="2020-06-15T13:16:09-07:00" level=info msg="[controlplane] Building up Controller Plane.."
time="2020-06-15T13:16:09-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:09-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:10-07:00" level=info msg="Starting container [kube-apiserver] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:10-07:00" level=info msg="[controlplane] Successfully started [kube-apiserver] container on host [172.24.173.65]"
time="2020-06-15T13:16:10-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-apiserver] on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="[healthcheck] service [kube-apiserver] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:18-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:18-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:18-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:18-07:00" level=info msg="Starting container [kube-controller-manager] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:19-07:00" level=info msg="[controlplane] Successfully started [kube-controller-manager] container on host [172.24.173.65]"
time="2020-06-15T13:16:19-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-controller-manager] on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="[healthcheck] service [kube-controller-manager] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:24-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:24-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:24-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:24-07:00" level=info msg="Starting container [kube-scheduler] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:25-07:00" level=info msg="[controlplane] Successfully started [kube-scheduler] container on host [172.24.173.65]"
time="2020-06-15T13:16:25-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-scheduler] on host [172.24.173.65]"
time="2020-06-15T13:16:30-07:00" level=info msg="[healthcheck] service [kube-scheduler] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:30-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:30-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:30-07:00" level=info msg="[controlplane] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:30-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:30-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:30-07:00" level=info msg="[controlplane] Successfully started Controller Plane.."
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating rke-job-deployer ServiceAccount"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] rke-job-deployer ServiceAccount created successfully"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating system:node ClusterRoleBinding"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] system:node ClusterRoleBinding created successfully"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] Creating kube-apiserver proxy ClusterRole and ClusterRoleBinding"
time="2020-06-15T13:16:30-07:00" level=info msg="[authz] kube-apiserver proxy ClusterRole and ClusterRoleBinding created successfully"
time="2020-06-15T13:16:31-07:00" level=info msg="Successfully Deployed state file at [./cluster1.rkestate]"
time="2020-06-15T13:16:31-07:00" level=info msg="[state] Saving full cluster state to Kubernetes"
time="2020-06-15T13:16:31-07:00" level=info msg="[state] Successfully Saved full cluster state to Kubernetes ConfigMap: full-cluster-state"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Building up Worker Plane.."
time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.65], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="[sidekick] Sidekick container already created on host [172.24.173.65]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [nginx-proxy] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.65]"
time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.65]"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [nginx-proxy] container on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [nginx-proxy] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [nginx-proxy] container on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Checking if container [service-sidekick] is running on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.66]"
time="2020-06-15T13:16:31-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="Starting container [kubelet] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:31-07:00" level=info msg="[worker] Successfully started [kubelet] container on host [172.24.173.67]"
time="2020-06-15T13:16:31-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kubelet] on host [172.24.173.67]"
time="2020-06-15T13:16:36-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:36-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:36-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:36-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:36-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.66] is healthy"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kubelet] on host [172.24.173.67] is healthy"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.65] is healthy"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.66]"
time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/hyperkube:v1.17.6-rancher2] exists on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="Starting container [kube-proxy] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:37-07:00" level=info msg="[worker] Successfully started [kube-proxy] container on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] Start Healthcheck on service [kube-proxy] on host [172.24.173.67]"
time="2020-06-15T13:16:37-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.66] is healthy"
time="2020-06-15T13:16:37-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:37-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[healthcheck] service [kube-proxy] on host [172.24.173.67] is healthy"
time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started [rke-log-linker] container on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-linker] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-linker] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="[worker] Successfully started Worker Plane.."
time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="Image [rancher/rke-tools:v0.1.56] exists on host [172.24.173.65]"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="Starting container [rke-log-cleaner] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.67]"
time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.66], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.67], try #1"
time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.66]"
time="2020-06-15T13:16:38-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.67]"
time="2020-06-15T13:16:39-07:00" level=info msg="[cleanup] Successfully started [rke-log-cleaner] container on host [172.24.173.65]"
time="2020-06-15T13:16:39-07:00" level=info msg="Removing container [rke-log-cleaner] on host [172.24.173.65], try #1"
time="2020-06-15T13:16:39-07:00" level=info msg="[remove/rke-log-cleaner] Successfully removed container on host [172.24.173.65]"
time="2020-06-15T13:16:39-07:00" level=info msg="[sync] Syncing nodes Labels and Taints"
time="2020-06-15T13:16:39-07:00" level=info msg="[sync] Successfully synced nodes Labels and Taints"
time="2020-06-15T13:16:39-07:00" level=info msg="[network] Setting up network plugin: calico"
time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-network-plugin to Kubernetes"
time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-network-plugin to Kubernetes"
time="2020-06-15T13:16:39-07:00" level=info msg="[addons] Executing deploy job rke-network-plugin"
time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Setting up coredns"
time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-coredns-addon to Kubernetes"
time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-coredns-addon to Kubernetes"
time="2020-06-15T13:16:44-07:00" level=info msg="[addons] Executing deploy job rke-coredns-addon"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] CoreDNS deployed successfully"
time="2020-06-15T13:16:49-07:00" level=info msg="[dns] DNS provider coredns deployed successfully"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Setting up Metrics Server"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-metrics-addon to Kubernetes"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-metrics-addon to Kubernetes"
time="2020-06-15T13:16:49-07:00" level=info msg="[addons] Executing deploy job rke-metrics-addon"
time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Metrics Server deployed successfully"
time="2020-06-15T13:16:54-07:00" level=info msg="[ingress] Setting up nginx ingress controller"
time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Saving ConfigMap for addon rke-ingress-controller to Kubernetes"
time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Successfully saved ConfigMap for addon rke-ingress-controller to Kubernetes"
time="2020-06-15T13:16:54-07:00" level=info msg="[addons] Executing deploy job rke-ingress-controller"
time="2020-06-15T13:17:00-07:00" level=info msg="[ingress] ingress controller nginx deployed successfully"
time="2020-06-15T13:17:00-07:00" level=info msg="[addons] Setting up user addons"
time="2020-06-15T13:17:00-07:00" level=info msg="[addons] no user addons defined"
time="2020-06-15T13:17:00-07:00" level=info msg="Finished building Kubernetes cluster successfully"

Thank you