Hi all,
Since this morning, I am no longer able to connect to the Rancher web interface. Indeed, I have the following message that appears:
Server error while authenticating
If I look at the logs of the pods present in namespace catlle-system, I have this which appears:
kubectl -n cattle-system logs -f rancher-7854b96f54-wh29h
2019/03/15 07:59:27 [ERROR] API error response 500 for POST /v3-public/localProviders/local?action=login. Cause: etcdserver: mvcc: database space exceeded
E0315 08:19:51.398281 9 leaderelection.go:258] Failed to update lock: etcdserver: mvcc: database space exceeded
I have installed Rancher on one server with the helm next command:
helm install rancher-latest/rancher --name rancher --namespace cattle-system --set hostname=mydomain.exemple.com --set ingress.tls.source=letsEncrypt --set letsEncrypt.email=toto@exemple.com
The helm list detail:
rancher 1 Fri Mar 1 12:24:19 2019 DEPLOYED rancher-2019.1.2 v2.1.6 cattle-system
The K8s objects:
kubectl -n cattle-system get all
NAME READY STATUS RESTARTS AGE
pod/cattle-cluster-agent-64f75b57fb-blmzf 1/1 Running 0 13d
pod/cattle-node-agent-fgcj6 1/1 Running 0 13d
pod/rancher-7854b96f54-wh29h 1/1 Running 3 13d
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/rancher ClusterIP 10.3.111.74 <none> 80/TCP 13d
NAME DESIRED CURRENT READY UP-TO-DATE AVAILABLE NODE SELECTOR AGE
daemonset.apps/cattle-node-agent 1 1 1 1 1 <none> 13d
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
deployment.apps/cattle-cluster-agent 1 1 1 1 13d
deployment.apps/rancher 1 1 1 1 13d
NAME DESIRED CURRENT READY AGE
replicaset.apps/cattle-cluster-agent-64f75b57fb 1 1 1 13d
replicaset.apps/rancher-7854b96f54 1 1 1 13d
In my search, i can read to launch etcd with the following argument:
--auto-compactage
But where is my etcd cluster for Rancher ?
I think I don’t understand something …
Thanks for your help.