Installing Rancher by run docker image on RHEL 8.5

Khaled_El_Sheikh · January 5, 2022, 8:51pm

Greetings All,

I’m have a new VM based on RHEL 8.5 and tried to install Rancher using the below simple command from formal rancher page here (Getting Started with Kubernetes | Rancher Quick Start)

sudo docker run --privileged -d --restart=unless-stopped -p 80:80 -p 443:443 rancher/rancher

but after the container start it keep restarting & the below errors appears.

Any Idea?

[root@redhat-vm-01 ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NA MES
e8fbd2a4d67e rancher/rancher “entrypoint.sh” 5 minutes ago Up 12 seconds 0.0.0.0:80->80/tcp, :::80->80/tcp, 0.0.0.0:443->443/tcp, :::443->443/tcp tr usting_shockley
[root@redhat-vm-01 ~]# docker logs -f e8fbd2a4d67e
2022/01/05 20:42:24 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:42:24 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:42:24 [INFO] Listening on /tmp/log.sock
2022/01/05 20:42:24 [INFO] Waiting for k3s to start
time=“2022-01-05T20:42:24Z” level=info msg=“Acquiring lock file /var/lib/rancher /k3s/data/.lock”
time=“2022-01-05T20:42:24Z” level=info msg=“Preparing data dir /var/lib/rancher/ k3s/data/e61cd97f31a54dbcd9893f8325b7133cfdfd0229ff3bfae5a4f845780a93e84c”
2022/01/05 20:42:25 [INFO] Waiting for k3s to start
2022/01/05 20:42:26 [INFO] Waiting for k3s to start
2022/01/05 20:42:28 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:42:30 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:42:32 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:42:34 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:42:36 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:42:48 [INFO] Running in single server mode, will not peer connecti ons
2022/01/05 20:42:48 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD navlinks.ui.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD clusters.management.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD apiservices.management.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD clusterregistrationtokens.management.cat tle.io
2022/01/05 20:42:50 [INFO] Applying CRD settings.management.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD preferences.management.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD clusterrepos.catalog.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD operations.catalog.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD apps.catalog.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD fleetworkspaces.management.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD bundles.fleet.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD clusters.fleet.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD managedcharts.management.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD clusters.provisioning.cattle.io
2022/01/05 20:42:50 [INFO] Applying CRD clusters.provisioning.cattle.io
2022/01/05 20:42:51 [INFO] Applying CRD rkeclusters.rke.cattle.io
2022/01/05 20:42:51 [INFO] Applying CRD rkecontrolplanes.rke.cattle.io
2022/01/05 20:42:51 [INFO] Applying CRD rkebootstraps.rke.cattle.io
2022/01/05 20:42:51 [INFO] Applying CRD rkebootstraptemplates.rke.cattle.io
2022/01/05 20:42:51 [INFO] Applying CRD rkecontrolplanes.rke.cattle.io
2022/01/05 20:42:51 [INFO] Applying CRD custommachines.rke.cattle.io
2022/01/05 20:42:51 [INFO] Applying CRD clusters.cluster.x-k8s.io
2022/01/05 20:42:51 [INFO] Applying CRD machinedeployments.cluster.x-k8s.io
2022/01/05 20:42:51 [INFO] Applying CRD machinehealthchecks.cluster.x-k8s.io
2022/01/05 20:42:51 [INFO] Applying CRD machines.cluster.x-k8s.io
2022/01/05 20:42:51 [INFO] Applying CRD machinesets.cluster.x-k8s.io
2022/01/05 20:42:51 [INFO] Waiting for CRD machinesets.cluster.x-k8s.io to becom e available
2022/01/05 20:42:52 [INFO] Done waiting for CRD machinesets.cluster.x-k8s.io to become available
2022/01/05 20:42:52 [INFO] Creating CRD authconfigs.management.cattle.io
2022/01/05 20:42:52 [INFO] Creating CRD groupmembers.management.cattle.io
2022/01/05 20:42:52 [INFO] Creating CRD groups.management.cattle.io
2022/01/05 20:42:52 [INFO] Creating CRD tokens.management.cattle.io
2022/01/05 20:42:52 [INFO] Creating CRD userattributes.management.cattle.io
2022/01/05 20:42:52 [INFO] Creating CRD users.management.cattle.io
2022/01/05 20:42:52 [INFO] Waiting for CRD users.management.cattle.io to become available
2022/01/05 20:42:53 [INFO] Done waiting for CRD users.management.cattle.io to be come available
2022/01/05 20:42:54 [INFO] Creating CRD clusterroletemplatebindings.management.c attle.io
2022/01/05 20:42:54 [INFO] Creating CRD catalogs.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD catalogtemplates.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD apps.project.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD dynamicschemas.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD apprevisions.project.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD etcdbackups.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD catalogtemplateversions.management.cattl e.io
2022/01/05 20:42:54 [INFO] Creating CRD globalrolebindings.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clusteralerts.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD pipelineexecutions.project.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD globalroles.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clusteralertgroups.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD pipelinesettings.project.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD kontainerdrivers.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clustercatalogs.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD pipelines.project.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD sourcecodecredentials.project.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD nodedrivers.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clusterloggings.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clusteralertrules.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD sourcecodeproviderconfigs.project.cattle .io
2022/01/05 20:42:54 [INFO] Creating CRD nodepools.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD nodetemplates.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clustermonitorgraphs.management.cattle.i o
2022/01/05 20:42:54 [INFO] Creating CRD sourcecoderepositories.project.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clusterscans.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD nodes.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD composeconfigs.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD podsecuritypolicytemplateprojectbindings .management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD podsecuritypolicytemplates.management.ca ttle.io
2022/01/05 20:42:54 [INFO] Waiting for CRD pipelinesettings.project.cattle.io to become available
2022/01/05 20:42:54 [INFO] Creating CRD multiclusterapps.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD projectnetworkpolicies.management.cattle .io
2022/01/05 20:42:54 [INFO] Creating CRD multiclusterapprevisions.management.catt le.io
2022/01/05 20:42:54 [INFO] Creating CRD projectroletemplatebindings.management.c attle.io
2022/01/05 20:42:54 [INFO] Creating CRD monitormetrics.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD projects.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD notifiers.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD rkek8ssystemimages.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD rkek8sserviceoptions.management.cattle.i o
2022/01/05 20:42:54 [INFO] Creating CRD projectalerts.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD rkeaddons.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD projectalertgroups.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD roletemplates.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD projectcatalogs.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD projectloggings.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD samltokens.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clustertemplates.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD projectalertrules.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD clustertemplaterevisions.management.catt le.io
2022/01/05 20:42:54 [INFO] Creating CRD projectmonitorgraphs.management.cattle.i o
2022/01/05 20:42:54 [INFO] Creating CRD cisconfigs.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD cisbenchmarkversions.management.cattle.i o
2022/01/05 20:42:54 [INFO] Creating CRD templates.management.cattle.io
2022/01/05 20:42:54 [INFO] Waiting for CRD nodepools.management.cattle.io to bec ome available
2022/01/05 20:42:54 [INFO] Creating CRD templateversions.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD templatecontents.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD globaldnses.management.cattle.io
2022/01/05 20:42:54 [INFO] Creating CRD globaldnsproviders.management.cattle.io
2022/01/05 20:42:54 [INFO] Done waiting for CRD pipelinesettings.project.cattle. io to become available
2022/01/05 20:42:54 [INFO] Waiting for CRD pipelines.project.cattle.io to become available
2022/01/05 20:42:55 [INFO] Waiting for CRD clusterscans.management.cattle.io to become available
2022/01/05 20:42:55 [INFO] Done waiting for CRD nodepools.management.cattle.io t o become available
2022/01/05 20:42:55 [INFO] Waiting for CRD nodetemplates.management.cattle.io to become available
2022/01/05 20:42:55 [INFO] Done waiting for CRD pipelines.project.cattle.io to b ecome available
2022/01/05 20:42:55 [INFO] Waiting for CRD sourcecodecredentials.project.cattle. io to become available
2022/01/05 20:42:55 [INFO] Done waiting for CRD clusterscans.management.cattle.i o to become available
2022/01/05 20:42:55 [INFO] Waiting for CRD composeconfigs.management.cattle.io t o become available
2022/01/05 20:42:55 [INFO] Done waiting for CRD nodetemplates.management.cattle. io to become available
2022/01/05 20:42:55 [INFO] Waiting for CRD nodes.management.cattle.io to become available
2022/01/05 20:42:56 [INFO] Done waiting for CRD sourcecodecredentials.project.ca ttle.io to become available
2022/01/05 20:42:56 [INFO] Waiting for CRD sourcecodeproviderconfigs.project.cat tle.io to become available
2022/01/05 20:42:56 [INFO] Done waiting for CRD composeconfigs.management.cattle .io to become available
2022/01/05 20:42:56 [INFO] Waiting for CRD projectcatalogs.management.cattle.io to become available
2022/01/05 20:42:56 [INFO] Done waiting for CRD nodes.management.cattle.io to be come available
2022/01/05 20:42:56 [INFO] Waiting for CRD roletemplates.management.cattle.io to become available
2022/01/05 20:42:56 [INFO] Done waiting for CRD sourcecodeproviderconfigs.projec t.cattle.io to become available
2022/01/05 20:42:56 [INFO] Waiting for CRD sourcecoderepositories.project.cattle .io to become available
2022/01/05 20:42:56 [INFO] Done waiting for CRD projectcatalogs.management.cattl e.io to become available
2022/01/05 20:42:56 [INFO] Waiting for CRD cisconfigs.management.cattle.io to be come available
2022/01/05 20:42:56 [INFO] Done waiting for CRD roletemplates.management.cattle. io to become available
2022/01/05 20:42:56 [INFO] Waiting for CRD clustertemplates.management.cattle.io to become available
2022/01/05 20:42:57 [INFO] Done waiting for CRD sourcecoderepositories.project.c attle.io to become available
2022/01/05 20:42:57 [INFO] Waiting for CRD pipelineexecutions.project.cattle.io to become available
2022/01/05 20:42:57 [INFO] Done waiting for CRD cisconfigs.management.cattle.io to become available
2022/01/05 20:42:57 [INFO] Waiting for CRD templates.management.cattle.io to bec ome available
2022/01/05 20:42:57 [INFO] Done waiting for CRD clustertemplates.management.catt le.io to become available
2022/01/05 20:42:57 [INFO] Waiting for CRD podsecuritypolicytemplateprojectbindi ngs.management.cattle.io to become available
2022/01/05 20:42:57 [INFO] Done waiting for CRD pipelineexecutions.project.cattl e.io to become available
2022/01/05 20:42:57 [INFO] Done waiting for CRD templates.management.cattle.io t o become available
2022/01/05 20:42:57 [INFO] Waiting for CRD templateversions.management.cattle.io to become available
2022/01/05 20:42:57 [INFO] Done waiting for CRD podsecuritypolicytemplateproject bindings.management.cattle.io to become available
2022/01/05 20:42:57 [INFO] Waiting for CRD samltokens.management.cattle.io to be come available
2022/01/05 20:42:58 [INFO] Done waiting for CRD templateversions.management.catt le.io to become available
2022/01/05 20:42:58 [INFO] Waiting for CRD globaldnsproviders.management.cattle. io to become available
2022/01/05 20:42:58 [INFO] Done waiting for CRD samltokens.management.cattle.io to become available
2022/01/05 20:42:58 [INFO] Waiting for CRD podsecuritypolicytemplates.management .cattle.io to become available
2022/01/05 20:42:58 [INFO] Done waiting for CRD globaldnsproviders.management.ca ttle.io to become available
2022/01/05 20:42:58 [INFO] Waiting for CRD projectalerts.management.cattle.io to become available
2022/01/05 20:42:58 [INFO] Done waiting for CRD podsecuritypolicytemplates.manag ement.cattle.io to become available
2022/01/05 20:42:58 [INFO] Waiting for CRD projectnetworkpolicies.management.cat tle.io to become available
2022/01/05 20:42:59 [INFO] Done waiting for CRD projectalerts.management.cattle. io to become available
2022/01/05 20:42:59 [INFO] Waiting for CRD projectalertrules.management.cattle.i o to become available
2022/01/05 20:42:59 [FATAL] k3s exited with: exit status 255
2022/01/05 20:43:17 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:43:17 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:43:17 [INFO] Listening on /tmp/log.sock
2022/01/05 20:43:17 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:43:19 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:43:21 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:43:23 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:43:25 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:43:27 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:43:29 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:43:35 [FATAL] k3s exited with: exit status 255
2022/01/05 20:43:53 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:43:53 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:43:53 [INFO] Listening on /tmp/log.sock
2022/01/05 20:43:53 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:43:55 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:43:57 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:43:59 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:44:01 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:44:03 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:44:05 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:44:07 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:44:09 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:44:15 [FATAL] k3s exited with: exit status 255
2022/01/05 20:44:31 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:44:31 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:44:31 [INFO] Listening on /tmp/log.sock
2022/01/05 20:44:31 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:44:33 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:44:35 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:44:37 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:44:39 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:44:41 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:44:43 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:44:45 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:44:50 [FATAL] k3s exited with: exit status 255
2022/01/05 20:45:08 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:45:08 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:45:08 [INFO] Listening on /tmp/log.sock
2022/01/05 20:45:08 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:10 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:12 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:14 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:16 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:18 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:45:20 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:45:22 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:45:24 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:45:26 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:45:28 [INFO] Running in single server mode, will not peer connecti ons
2022/01/05 20:45:28 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:45:29 [INFO] Applying CRD navlinks.ui.cattle.io
2022/01/05 20:45:29 [INFO] Applying CRD clusters.management.cattle.io
2022/01/05 20:45:29 [INFO] Applying CRD apiservices.management.cattle.io
2022/01/05 20:45:29 [INFO] Applying CRD clusterregistrationtokens.management.cat tle.io
2022/01/05 20:45:29 [INFO] Applying CRD settings.management.cattle.io
2022/01/05 20:45:29 [INFO] Applying CRD preferences.management.cattle.io
2022/01/05 20:45:30 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:45:30 [INFO] Applying CRD clusterrepos.catalog.cattle.io
2022/01/05 20:45:30 [INFO] Applying CRD operations.catalog.cattle.io
2022/01/05 20:45:30 [INFO] Applying CRD apps.catalog.cattle.io
2022/01/05 20:45:30 [INFO] Applying CRD fleetworkspaces.management.cattle.io
2022/01/05 20:45:30 [INFO] Applying CRD managedcharts.management.cattle.io
2022/01/05 20:45:31 [FATAL] failed to update managedcharts.management.cattle.io apiextensions.k8s.io/v1, Kind=CustomResourceDefinition for managedcharts.manage ment.cattle.io: Patch “https://127.0.0.1:6443/apis/apiextensions.k8s.io/v1/custo mresourcedefinitions/managedcharts.management.cattle.io?timeout=15m0s”: EOF
2022/01/05 20:45:47 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:45:47 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:45:47 [INFO] Listening on /tmp/log.sock
2022/01/05 20:45:47 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:49 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:51 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:53 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:45:55 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:45:57 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:45:59 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:46:01 [INFO] Running in single server mode, will not peer connecti ons
2022/01/05 20:46:01 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:46:03 [INFO] Applying CRD navlinks.ui.cattle.io
2022/01/05 20:46:03 [INFO] Applying CRD clusters.management.cattle.io
2022/01/05 20:46:03 [FATAL] failed to update clusters.management.cattle.io apiex tensions.k8s.io/v1, Kind=CustomResourceDefinition for clusters.management.cattl e.io: Patch “https://127.0.0.1:6443/apis/apiextensions.k8s.io/v1/customresourced efinitions/clusters.management.cattle.io?timeout=15m0s”: EOF
2022/01/05 20:46:22 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:46:22 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:46:22 [INFO] Listening on /tmp/log.sock
2022/01/05 20:46:22 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:46:24 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:46:26 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:46:28 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:46:30 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:46:32 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:46:34 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:46:36 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:46:38 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:46:40 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:46:46 [FATAL] k3s exited with: exit status 255
2022/01/05 20:47:03 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:47:03 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:47:03 [INFO] Listening on /tmp/log.sock
2022/01/05 20:47:03 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:05 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:07 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:09 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:11 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:13 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:15 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:47:17 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:47:19 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:47:21 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:47:23 [INFO] Running in single server mode, will not peer connecti ons
2022/01/05 20:47:23 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:47:24 [INFO] Applying CRD navlinks.ui.cattle.io
2022/01/05 20:47:24 [INFO] Applying CRD clusters.management.cattle.io
2022/01/05 20:47:24 [INFO] Applying CRD apiservices.management.cattle.io
2022/01/05 20:47:24 [INFO] Applying CRD clusterregistrationtokens.management.cat tle.io
2022/01/05 20:47:24 [INFO] Applying CRD settings.management.cattle.io
2022/01/05 20:47:24 [INFO] Applying CRD preferences.management.cattle.io
2022/01/05 20:47:24 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD clusterrepos.catalog.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD operations.catalog.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD apps.catalog.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD fleetworkspaces.management.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD managedcharts.management.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD clusters.provisioning.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD clusters.provisioning.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD rkeclusters.rke.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD rkecontrolplanes.rke.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD rkebootstraps.rke.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD rkebootstraptemplates.rke.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD rkecontrolplanes.rke.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD custommachines.rke.cattle.io
2022/01/05 20:47:25 [INFO] Applying CRD clusters.cluster.x-k8s.io
2022/01/05 20:47:26 [INFO] Applying CRD machinedeployments.cluster.x-k8s.io
2022/01/05 20:47:26 [INFO] Applying CRD machinehealthchecks.cluster.x-k8s.io
2022/01/05 20:47:26 [FATAL] failed to list apiextensions.k8s.io/v1, Kind=CustomR esourceDefinition for machinehealthchecks.cluster.x-k8s.io: Get “https://127.0. 0.1:6443/apis/apiextensions.k8s.io/v1/customresourcedefinitions?labelSelector=ob jectset.rio.cattle.io%!F(MISSING)hash%!D(MISSING)7372e5228a5d4df32e62db137ea6bf4 69c35d4c4&timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connection refused
2022/01/05 20:47:44 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:47:44 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:47:44 [INFO] Listening on /tmp/log.sock
2022/01/05 20:47:44 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:46 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:48 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:50 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:47:52 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:47:54 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:47:56 [INFO] Waiting for server to become available: an error on t he server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:48:02 [FATAL] k3s exited with: exit status 255
2022/01/05 20:48:20 [INFO] Rancher version v2.6.3 (3c1d5fac3) is starting
2022/01/05 20:48:20 [INFO] Rancher arguments {ACMEDomains: AddLocal:true Embed ded:false BindHost: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:fal se Trace:false NoCACerts:false AuditLogPath:/var/log/auditlog/rancher-api-audit. log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Feat ures: ClusterRegistry:}
2022/01/05 20:48:20 [INFO] Listening on /tmp/log.sock
2022/01/05 20:48:21 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:48:23 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:48:25 [INFO] Waiting for server to become available: Get “https:// 127.0.0.1:6443/version?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connect ion refused
2022/01/05 20:48:27 [INFO] Waiting for server to become available: an error on the server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:48:29 [INFO] Waiting for server to become available: an error on the server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:48:31 [INFO] Waiting for server to become available: an error on the server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:48:33 [INFO] Waiting for server to become available: an error on the server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:48:35 [INFO] Waiting for server to become available: an error on the server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:48:37 [INFO] Waiting for server to become available: an error on the server (“apiserver not ready”) has prevented the request from succeeding
2022/01/05 20:48:39 [INFO] Running in single server mode, will not peer connections
2022/01/05 20:48:39 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:48:39 [INFO] Applying CRD navlinks.ui.cattle.io
2022/01/05 20:48:40 [INFO] Applying CRD clusters.management.cattle.io
2022/01/05 20:48:40 [INFO] Applying CRD apiservices.management.cattle.io
2022/01/05 20:48:40 [INFO] Applying CRD clusterregistrationtokens.management.cattle.io
2022/01/05 20:48:40 [INFO] Applying CRD settings.management.cattle.io
2022/01/05 20:48:40 [INFO] Applying CRD preferences.management.cattle.io
2022/01/05 20:48:40 [INFO] Applying CRD features.management.cattle.io
2022/01/05 20:48:40 [INFO] Applying CRD clusterrepos.catalog.cattle.io
2022/01/05 20:48:41 [FATAL] Get “https://127.0.0.1:6443/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusterrepos.catalog.cattle.io?timeout=15m0s”: dial tcp 127.0.0.1:6443: connect: connection refused

anandr781 · January 6, 2022, 5:56am

From what I have seen rancher V2.6.3 it take a while to settle down and be ok . did you try waiting for sometime and try docker stop / docker run …

Khaled_El_Sheikh · January 6, 2022, 6:28am

Hi @anandr781 ,

Thanks dor your response. But the docker container is keeping restarting every 30 second due to this error. I have tried the same instalation on Ubuntu and it is working fine not sure why such issue on RHEL it happen while installing the same at customer side and on my new machines. Seems there is a compatability issue between Rancher & RHEL

anandr781 · January 6, 2022, 8:44am

Hmm, thats strange the reason I say that I got it work on CentOS 7 (see here : Stuck at "Waiting for API to be available" - #4 by anandr781) . I run my stack using CentOS.

Did you verify the docker version that you are running and check if its compatible with Rancher 2.6.3 ?

Khaled_El_Sheikh · January 6, 2022, 12:19pm

. Also same docker engine used on ubuntu and it is working fine
I used only docker version script on rancher documentation

wcoateRR · January 6, 2022, 3:22pm

Docker does use the running kernel, and Ubuntu’s normally newer. If you verified you’re using the same version of docker package installed then kernel version or if there’s a different mix & match and you happen to need another package on one distro that’s included in the basic (or dependencies) are my other two guesses.

Khaled_El_Sheikh · January 6, 2022, 3:56pm

Thanks for the response. I’m very confused & not sure which version of docker I need to install as I cannot tell the customer to change all machines to Ubuntu or use old version of docker which has log4j issues

wcoateRR · January 6, 2022, 4:10pm

If it’s a docker version or package difference, you can grab the version of docker you need from Docker’s yum repo and push to a customer’s local yum repo (or just have them as separate standalone RPMs to install via yum). If you want you could do that on fresh RHEL & Ubuntu test systems to validate you’re getting all the same packages too.

Khaled_El_Sheikh · January 6, 2022, 4:41pm

Thank you. I did now 6 installations for different dockers on fresh machines all are working on Ubuntu normally but not working on RHEL. Seems Rancher is not a good option for installing Kuberenetes on enterprise Linux from Redhat

wcoateRR · January 6, 2022, 5:04pm

It worked ok for me on CentOS 7 with just Docker run when I did a quick test. Doing a full HA install with Helm & RKE2 & having SELinux enabled was a bit of a pain, but if I would’ve disabled SELinux & FirewallD to start with that would’ve gone smoothly too. So it can work with RHEL 7 variants, and likely works with 8, but might need a dependency you didn’t notice that Ubuntu has by default.

EDIT - I didn’t get a lot of replies here, but I had much better luck on their Slack with getting Rancher employees pitching in with answers. You might try there too.

Khaled_El_Sheikh · January 7, 2022, 7:50am

Thank you very much I will try to post the issue on their slack

SaschaR · January 18, 2022, 1:53pm

Maybe this thread will help you:

No solution has been communicated yet, but we found out that it happens at a certain kernel version.

regards
Sascha

fazren · June 16, 2022, 7:14pm

Hi
Check the k3s.log file by executing to the rancher container. I found some ip table related errors in k3s.log. Then following doc helped me to fix the issue. stackoverflow
In my environment, Im running rancher v2.6.5 with Red Hat 8.6. This might be helpfull to you

SaschaR · June 20, 2022, 7:00am

@fazren
Thanks for your reply.

I used this hint to get it work on Rocky OS 8 with newest updates, slightly modified.

sudo modprobe ip_tables
sudo echo 'ip_tables' >> /etc/modules-load.d/rancher.conf
sudo reboot

regards
Sascha

sanghv · July 10, 2024, 9:41am

this issue you disabled selinux is ok

Topic		Replies	Views
Rancher 2.7 on Docker fails start after server reboot Rancher	5	6241	March 7, 2023
Fresh installation of Rancher Server fails - Container keeps restarting Rancher	4	3385	August 2, 2021
PANIC: Failed to start rancher:server Rancher	0	1126	March 17, 2020
Rancher stops responding and restarts regularly Rancher	13	7024	December 10, 2020
Error for install Rancher 2.6.8 (rancher/rancher:v2.6.8) on Ubuntu 20.04 (5.15.0-50-generic), but it keeps restarting the Docker container all the tim Rancher	2	879	November 29, 2022

Installing Rancher by run docker image on RHEL 8.5

Related topics