ClusterController: failed to start user controllers: Unauthorized

Rancher 2.x
1

Hi,

after upgrading from Rancher 2.2.8 to 2.3.2 single and K8s from 1.11 to 1.16, we are having the following error:
[ERROR] ClusterController c-hdx96 [user-controllers-controller] failed with : failed to start user controllers for cluster c-dzrz7: failed to contact server: Unauthorized

Which server is denying the request?

We are having also some errors about handshakes on:

  • master: “http: TLS handshake error from 127.0.0.1:50508: EOF”
  • registering a new cluster controller/rancher-agent: “level=error msg=“Failed to connect to proxy. Response status: 200 - 200 OK. Response body: node.management.cattle.io “c-dzrz7/m-6a7f4a83c4e6” not found” error=“websocket: bad handshake””

Meanwhile, on Rancher UI, we can’t see any information on the dashboard and the nodes page is outdated.

Thanks.

2 Likes
2

Did you manage to fix this?

Have a similar issue when trying to import a cluster from Google cloud in a Rancher running in AWS. Response is 200 ok, but it complains about a proxy which I don’t (think I) have:

level=info msg="Connecting to wss://MYDNS/v3/connect with token xxx"
level=info msg="Connecting to proxy" url="wss://MYDNS/v3/connect"
level=error msg="Failed to connect to proxy. Response status: 200 - 200 OK. Response 
body: node.management.cattle.io \"c-wjkc9/m-38115dee6999\" not found" 
error="websocket: bad handshake"
level=error msg="Remotedialer proxy error" error="websocket: bad handshake"

Thanks