Hello, we are experiencing a significant issues int he DNS system in Rancher.
We are running 3 tier system like so:
Rancher LBs -> service A -> Service B
we are currently running 3 instances of Service A and 2 instances of Service B
We are running the Rancher LB on each host which is routing traffic to Service A.
When we hit the Load balancer, we are seeing each service A pair up with a single copy of Service B and never round-robin.
When, I jumped in the shell in Service A, and perform a
dig serviceB, I do see the results switch appropriately. So the DNS server seems to be round robin the results.
However, if I install
curl and do a
curl serviceB, it will only hit a single copy of service B.
This is an enormous issue as it creates a totally imbalanced network load and it’s completely non-deterministic about which container it will link to.