Hey there, Im trying to set p a local ha rancher system so I can learn how to set one up on our production env. I have 4 VMs set up on a local nat network.
Vm 1 has nginx rke helm and kubectl ip 10.0.2.12
Vm 2,3,4 have rke helm and kubectl ip 10.0.2.7 , 10.0.2.8 , 10.0.2.9
rke cluster config
nodes: - address: 10.0.2.7 internal_address: 10.0.2.7 user: dev role: [controlplane,worker,etcd] - address: 10.0.2.8 internal_address: 10.0.2.8 user: dev role: [controlplane,worker,etcd] - address: 10.0.2.9 internal_address: 10.0.2.9 user: dev role: [controlplane,worker,etcd] services: etcd: snapshot: true creation: 6h retention: 24h
I am able to set up the kubernetes cluster but somethings are happening…
In the tutorial on the rancher docs it says that when you run:
rke up --config ./rancher-cluster.yml export KUBECONFIG=$(pwd)/kube_config_rancher-cluster.yml kubectl get nodes
that you should get the three nodes. I do and they all say that they are ready:
10.0.2.7 Ready controlplane,etcd,worker 95s v1.15.5 10.0.2.8 Ready controlplane,etcd,worker 96s v1.15.5 10.0.2.9 Ready controlplane,etcd,worker 96s v1.15.5
But when I do:
kubectl get pods --all-namespaces
NAMESPACE NAME READY STATUS RESTARTS AGE ingress-nginx default-http-backend-5bcc9fd598-9rxg5 1/1 Running 0 20m ingress-nginx nginx-ingress-controller-8j4sm 1/1 Running 0 20m ingress-nginx nginx-ingress-controller-k9gdc 1/1 Running 0 20m ingress-nginx nginx-ingress-controller-xxwlh 1/1 Running 0 20m kube-system canal-9xdlr 2/2 Running 0 20m kube-system canal-jmmph 2/2 Running 0 20m kube-system canal-lp2cw 2/2 Running 0 20m kube-system coredns-799dffd9c4-twgch 1/1 Running 1 20m kube-system coredns-autoscaler-84766fbb4-msdpv 1/1 Running 0 20m kube-system metrics-server-59c6fd6767-szmxx 1/1 Running 1 20m kube-system rke-coredns-addon-deploy-job-xsv7j 0/1 Completed 0 20m kube-system rke-ingress-controller-deploy-job-xlknv 0/1 Completed 0 20m kube-system rke-metrics-addon-deploy-job-fnprk 0/1 Completed 0 20m kube-system rke-network-plugin-deploy-job-hr8xn 0/1 Completed 0 20m
It looks all good, but I have three nodes and I only see 2/2. In the tutorial it also says 3/3…
This is my first concern. Second which is the real killer is when I go to install cert-manager with helm…
After running the first commands everything goes well… until I get to the last part.
helm install \ --name cert-manager \ --namespace cert-manager \ --version v0.9.1 \ jetstack/cert-manager
In which after like 2 mins I get :
Error: Could not get apiVersions from Kubernetes: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
What am I doing wrong…?
Note: Please for give me if I have forgotten to say things… I wrote this before lunch and I am not running on all cylinders.