When trying to build a cluster, I am getting the below error;
[controlPlane] Failed to bring up Control Plane: [Failed to verify healthcheck: Failed to check https://localhost:6443/healthz for service [kube-apiserver] on host [ip]: Get “https://localhost:6443/healthz”: dial tcp ip:6443: connect: connection refused, log: I0517 07:22:29.622640 1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io]
We are using Rancher version 2.7.3 with Ubuntu 22.04 as the node OS. There is no firewall enabled in the OS.
Cluster is creating without any issues if the node OS is Ubuntu 20.04 or 18.04.
When checking the etcd log I can see the below “rejected connection” errors;
{“log”:“{"level":"warn","ts":"2023-05-17T07:45:48.588Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"ip:40329","server-name":"","error":"EOF"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:45:48.588377977Z”}
{“log”:“{"level":"warn","ts":"2023-05-17T07:45:48.594Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"ip:42525","server-name":"","error":"EOF"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:45:48.594965691Z”}
{“log”:“{"level":"warn","ts":"2023-05-17T07:45:48.610Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"ip:37411","server-name":"","error":"EOF"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:45:48.610364014Z”}
{“log”:“{"level":"info","ts":"2023-05-17T07:47:25.149Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":566}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:47:25.150571512Z”}
{“log”:“{"level":"info","ts":"2023-05-17T07:47:25.150Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":566,"took":"208.721µs"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:47:25.15061262Z”}
{“log”:“{"level":"info","ts":"2023-05-17T07:52:25.157Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":657}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:52:25.157568906Z”}
{“log”:“{"level":"info","ts":"2023-05-17T07:52:25.157Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":657,"took":"344.145µs"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:52:25.157899501Z”}
{“log”:“{"level":"info","ts":"2023-05-17T07:57:25.165Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":748}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:57:25.165411671Z”}
{“log”:“{"level":"info","ts":"2023-05-17T07:57:25.165Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":748,"took":"152.286µs"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:57:25.165626685Z”}
{“log”:“{"level":"warn","ts":"2023-05-17T07:57:30.883Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"ip:39469","server-name":"","error":"EOF"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:57:30.88336121Z”}
{“log”:“{"level":"warn","ts":"2023-05-17T07:57:30.884Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"ip:34403","server-name":"","error":"EOF"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:57:30.884784848Z”}
{“log”:“{"level":"warn","ts":"2023-05-17T07:57:30.887Z","caller":"embed/config_logging.go:169","msg":"rejected connection","remote-addr":"ip:46411","server-name":"","error":"EOF"}\n”,“stream”:“stderr”,“time”:“2023-05-17T07:57:30.888030631Z”}
Please help to resolve this.