Unable to add a new host for kubernetes cluster - Stuck for last 1 hour

Rancher 1.x
1

a few seconds ago service.reconcile Waiting for [instance:Kubernetes_kubelet_1]. Instance status: Post-network SEM15-PS-46051-Kubernetes service: 1s90

a few seconds ago service.reconcile Waiting for [instance:Kubernetes_controller-manager_1]. Instance status: null

2

6/23/2016 1:05:41 AMtime=“2016-06-23T05:05:41Z” level=error msg="Healtcheck failed for LB controller"
6/23/2016 1:05:44 AMtime=“2016-06-23T05:05:44Z” level=error msg="Health check failed: unable to reach Kubernetes. Error: &url.Error{Op:“Get”, URL:“http://master/apis/extensions/v1beta1/ingresses”, Err:(*net.OpError)(0xc82055cc80)}"
6/23/2016 1:05:44 AMtime=“2016-06-23T05:05:44Z” level=error msg="Healtcheck failed for LB controller"
6/23/2016 1:05:46 AMtime=“2016-06-23T05:05:46Z” level=error msg="Health check failed: unable to reach Kubernetes. Error: &url.Error{Op:“Get”, URL:“http://master/apis/extensions/v1beta1/ingresses”, Err:(*net.OpError)(0xc8203a7590)}"
6/23/2016 1:05:46 AMtime=“2016-06-23T05:05:46Z” level=error msg="Healtcheck failed for LB controller"
6/23/2016 1:05:48 AMtime=“2016-06-23T05:05:48Z” level=error msg="Health check failed: unable to reach Kubernetes. Error: &url.Error{Op:“Get”, URL:“http://master/apis/extensions/v1beta1/ingresses”, Err:(*net.OpError)(0xc8203e4460)}"
6/23/2016 1:05:48 AMtime=“2016-06-23T05:05:48Z” level=error msg="Healtcheck failed for LB controller"
6/23/2016 1:05:50 AMtime=“2016-06-23T05:05:50Z” level=error msg="Health check failed: unable to reach Kubernetes. Error: &url.Error{Op:“Get”, URL:“http://master/apis/extensions/v1beta1/ingresses”, Err:(*net.OpError)(0xc8203e4cd0)}"
6/23/2016 1:05:50 AMtime=“2016-06-23T05:05:50Z” level=error msg="Healtcheck failed for LB controller"
6/23/2016 1:05:52 AMtime=“2016-06-23T05:05:52Z” level=error msg="Health check failed: unable to reach Kubernetes. Error: &url.Error{Op:“Get”, URL:“http://master/apis/extensions/v1beta1/ingresses”, Err:(*net.OpError)(0xc8203e5ae0)}"
6/23/2016 1:05:52 AMtime=“2016-06-23T05:05:52Z” level=error msg=“Healtcheck failed for LB controller”

3

What version of Rancher are you using?

4

Hi,

I’m getting the same error on my setup. Is there a solution / ideas for this problem? I am using v1.10 and testing on a ‘cluster’ of 3 virtual machines (using vagrant + virtual box). I have tried both Centos 7.2 and Ubuntu 14.04.4.LTS.

What is a little curious is that I have a single sever + single host setup on Azure (Centos 7.2 VMs) and it appears to work just fine.

In my particular case the ‘Setting up Kubernetes’ is stuck at 8/9 and the error messages are:

time=“2016-07-07T12:39:55Z” level=error msg=“Health check failed: unable to reach Kubernetes. Error: &url.Error{Op:“Get”, URL:“http://master/apis/extensions/v1beta1/ingresses”, Err:(*net.OpError)(0xc8201634a0)}”

time=“2016-07-07T12:39:55Z” level=error msg=“Healtcheck failed for LB controller”

Any info would be much appreciated.

Thanks,
Si

5

Have you confirmed that across your hosts one of the k8s container that spins up is able to ping the IP of another container on another host (10.42.x.x.)? Health checks typically fail because cross host communication isn’t working.