Canal pod : Readiness probe failed

Hi

Networking policy pods keep on throwing back-off restarting failed container errors.
We are trying to set up a fresh cluster for on-premise env on ubuntu16 hostOS.

the error is – Readiness probe failed: Get http://localhost:9099/readiness: dial tcp 127.0.0.1:9099: connect: connection refused

any clue what went wrong ?

Thanks in advance!

I believe this is related to https://github.com/kubernetes/kubernetes/issues/72102
Which fixed for me by upgrading to rancher 2.2.4
Which updates the underlying RKE toolset for rancher
I then upgraded the cluster (without touching the broken nodes) to v1.13.5-rancher1-3
and the broken nodes started working again (the canal part, the actual cluster was never unstable)