We have a Rancher server (1.5.5).
We have problems with 2 hosts which have 7 containers running. A third host has 7 Rancher load balancers to balance traffic other them.
Very often, containers on one host got their status changed to “Degraded”.
After some investigations, we noted in the “network-manager” logs that the CNI goes up and down every 4-5 fives seconds :
> 06/04/2018 09:26:43time=“2018-04-06T07:26:43Z” level=info msg=“CNI up done” cid=c4d2eec26607022a4e9c6a8edbcd4d6bc84a77b5ef4bdc6ba4478223c3e32812 networkMode=ipsec result=IP4:{IP:{IP:10.42.157.200 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:27:56time=“2018-04-06T07:27:56Z” level=info msg=“CNI down” cid=c4d2eec26607022a4e9c6a8edbcd4d6bc84a77b5ef4bdc6ba4478223c3e32812 networkMode=ipsec
06/04/2018 09:28:13time=“2018-04-06T07:28:13Z” level=info msg=“Setting up resolv.conf for ContainerId [c6ec6ba8a2abcf31c51affcd6d7cf450c713a21599e68157d62d8b8ec4dba076]”
06/04/2018 09:28:13time=“2018-04-06T07:28:13Z” level=info msg=“CNI up” cid=c6ec6ba8a2abcf31c51affcd6d7cf450c713a21599e68157d62d8b8ec4dba076 networkMode=ipsec
06/04/2018 09:28:13time=“2018-04-06T07:28:13Z” level=info msg=“CNI up done” cid=c6ec6ba8a2abcf31c51affcd6d7cf450c713a21599e68157d62d8b8ec4dba076 networkMode=ipsec result=IP4:{IP:{IP:10.42.230.200 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:32:21net.ipv4.conf.docker0.route_localnet = 1
06/04/2018 09:32:22time=“2018-04-06T07:32:22Z” level=info msg=“CNI down” cid=c6ec6ba8a2abcf31c51affcd6d7cf450c713a21599e68157d62d8b8ec4dba076 networkMode=ipsec
06/04/2018 09:32:28time=“2018-04-06T07:32:28Z” level=info msg=“Setting up resolv.conf for ContainerId [faed40f996a0d83355ea8ff239041c6e022d681ad9777609c5126d0b6a16d40a]”
06/04/2018 09:32:28time=“2018-04-06T07:32:28Z” level=info msg=“CNI up” cid=faed40f996a0d83355ea8ff239041c6e022d681ad9777609c5126d0b6a16d40a networkMode=ipsec
06/04/2018 09:32:29time=“2018-04-06T07:32:29Z” level=info msg=“CNI up done” cid=faed40f996a0d83355ea8ff239041c6e022d681ad9777609c5126d0b6a16d40a networkMode=ipsec result=IP4:{IP:{IP:10.42.11.201 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:33:24time=“2018-04-06T07:33:24Z” level=info msg=“CNI down” cid=faed40f996a0d83355ea8ff239041c6e022d681ad9777609c5126d0b6a16d40a networkMode=ipsec
06/04/2018 09:33:43time=“2018-04-06T07:33:43Z” level=info msg=“Setting up resolv.conf for ContainerId [2ee6421a49760421b7f39dcebdc8a461517da77f7b4312475d09f6368c27756d]”
06/04/2018 09:33:43time=“2018-04-06T07:33:43Z” level=info msg=“CNI up” cid=2ee6421a49760421b7f39dcebdc8a461517da77f7b4312475d09f6368c27756d networkMode=ipsec
06/04/2018 09:33:43time=“2018-04-06T07:33:43Z” level=info msg=“CNI up done” cid=2ee6421a49760421b7f39dcebdc8a461517da77f7b4312475d09f6368c27756d networkMode=ipsec result=IP4:{IP:{IP:10.42.38.150 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:34:43time=“2018-04-06T07:34:43Z” level=info msg=“CNI down” cid=2ee6421a49760421b7f39dcebdc8a461517da77f7b4312475d09f6368c27756d networkMode=ipsec
06/04/2018 09:34:59time=“2018-04-06T07:34:59Z” level=info msg=“Setting up resolv.conf for ContainerId [0d41d8ac023d2f5e68c0463e8db15d44239551d06c52c75cdfd56f2d510a934a]”
06/04/2018 09:34:59time=“2018-04-06T07:34:59Z” level=info msg=“CNI up” cid=0d41d8ac023d2f5e68c0463e8db15d44239551d06c52c75cdfd56f2d510a934a networkMode=ipsec
06/04/2018 09:34:59time=“2018-04-06T07:34:59Z” level=info msg=“CNI up done” cid=0d41d8ac023d2f5e68c0463e8db15d44239551d06c52c75cdfd56f2d510a934a networkMode=ipsec result=IP4:{IP:{IP:10.42.31.104 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:36:17time=“2018-04-06T07:36:17Z” level=info msg=“CNI down” cid=0d41d8ac023d2f5e68c0463e8db15d44239551d06c52c75cdfd56f2d510a934a networkMode=ipsec
06/04/2018 09:36:28time=“2018-04-06T07:36:28Z” level=info msg=“Setting up resolv.conf for ContainerId [aaf1313617cdb04d1190a4c2b8337e29b0f680fc863e7b66e15e9872df49a14f]”
06/04/2018 09:36:28time=“2018-04-06T07:36:28Z” level=info msg=“CNI up” cid=aaf1313617cdb04d1190a4c2b8337e29b0f680fc863e7b66e15e9872df49a14f networkMode=ipsec
06/04/2018 09:36:28time=“2018-04-06T07:36:28Z” level=info msg=“CNI up done” cid=aaf1313617cdb04d1190a4c2b8337e29b0f680fc863e7b66e15e9872df49a14f networkMode=ipsec result=IP4:{IP:{IP:10.42.52.163 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:37:28net.ipv4.conf.docker0.route_localnet = 1
06/04/2018 09:37:42time=“2018-04-06T07:37:42Z” level=info msg=“CNI down” cid=aaf1313617cdb04d1190a4c2b8337e29b0f680fc863e7b66e15e9872df49a14f networkMode=ipsec
06/04/2018 09:37:59time=“2018-04-06T07:37:59Z” level=info msg=“Setting up resolv.conf for ContainerId [1bafa5d06dce061215b9cbf29b4b50682ce078742aa77424fe29fd2e36d0d80f]”
06/04/2018 09:37:59time=“2018-04-06T07:37:59Z” level=info msg=“CNI up” cid=1bafa5d06dce061215b9cbf29b4b50682ce078742aa77424fe29fd2e36d0d80f networkMode=ipsec
06/04/2018 09:37:59time=“2018-04-06T07:37:59Z” level=info msg=“CNI up done” cid=1bafa5d06dce061215b9cbf29b4b50682ce078742aa77424fe29fd2e36d0d80f networkMode=ipsec result=IP4:{IP:{IP:10.42.18.129 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:41:57time=“2018-04-06T07:41:57Z” level=info msg=“CNI down” cid=1bafa5d06dce061215b9cbf29b4b50682ce078742aa77424fe29fd2e36d0d80f networkMode=ipsec
06/04/2018 09:42:13time=“2018-04-06T07:42:13Z” level=info msg=“Setting up resolv.conf for ContainerId [60a6522593aa5c35190e791df972e362c25efb13e90d047d1f092e2d2e74b72f]”
06/04/2018 09:42:13time=“2018-04-06T07:42:13Z” level=info msg=“CNI up” cid=60a6522593aa5c35190e791df972e362c25efb13e90d047d1f092e2d2e74b72f networkMode=ipsec
06/04/2018 09:42:14time=“2018-04-06T07:42:14Z” level=info msg=“CNI up done” cid=60a6522593aa5c35190e791df972e362c25efb13e90d047d1f092e2d2e74b72f networkMode=ipsec result=IP4:{IP:{IP:10.42.197.176 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:42:30net.ipv4.conf.docker0.route_localnet = 1
06/04/2018 09:42:30time=“2018-04-06T07:42:30Z” level=info msg=“CNI down” cid=60a6522593aa5c35190e791df972e362c25efb13e90d047d1f092e2d2e74b72f networkMode=ipsec
06/04/2018 09:42:43time=“2018-04-06T07:42:43Z” level=info msg=“Setting up resolv.conf for ContainerId [d925bc616d977a0fce0034fa6e796204edfe871321c55f44919c354002f46257]”
06/04/2018 09:42:43time=“2018-04-06T07:42:43Z” level=info msg=“CNI up” cid=d925bc616d977a0fce0034fa6e796204edfe871321c55f44919c354002f46257 networkMode=ipsec
06/04/2018 09:42:43time=“2018-04-06T07:42:43Z” level=info msg=“CNI up done” cid=d925bc616d977a0fce0034fa6e796204edfe871321c55f44919c354002f46257 networkMode=ipsec result=IP4:{IP:{IP:10.42.211.228 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:43:37time=“2018-04-06T07:43:37Z” level=info msg=“CNI down” cid=d925bc616d977a0fce0034fa6e796204edfe871321c55f44919c354002f46257 networkMode=ipsec
06/04/2018 09:43:43time=“2018-04-06T07:43:43Z” level=info msg=“Setting up resolv.conf for ContainerId [6e13068c549a995bbe944854aebafa5340a275339f39cc7b8bf8d6b6997b350f]”
06/04/2018 09:43:43time=“2018-04-06T07:43:43Z” level=info msg=“CNI up” cid=6e13068c549a995bbe944854aebafa5340a275339f39cc7b8bf8d6b6997b350f networkMode=ipsec
06/04/2018 09:43:43time=“2018-04-06T07:43:43Z” level=info msg=“CNI up done” cid=6e13068c549a995bbe944854aebafa5340a275339f39cc7b8bf8d6b6997b350f networkMode=ipsec result=IP4:{IP:{IP:10.42.11.188 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:45:02time=“2018-04-06T07:45:02Z” level=info msg=“CNI down” cid=6e13068c549a995bbe944854aebafa5340a275339f39cc7b8bf8d6b6997b350f networkMode=ipsec
06/04/2018 09:45:13time=“2018-04-06T07:45:13Z” level=info msg=“Setting up resolv.conf for ContainerId [7d151f5f64b04c5cd4aca946fbb71803b394f219a229e24fc70231e673511954]”
06/04/2018 09:45:13time=“2018-04-06T07:45:13Z” level=info msg=“CNI up” cid=7d151f5f64b04c5cd4aca946fbb71803b394f219a229e24fc70231e673511954 networkMode=ipsec
06/04/2018 09:45:13time=“2018-04-06T07:45:13Z” level=info msg=“CNI up done” cid=7d151f5f64b04c5cd4aca946fbb71803b394f219a229e24fc70231e673511954 networkMode=ipsec result=IP4:{IP:{IP:10.42.103.214 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:46:36time=“2018-04-06T07:46:36Z” level=info msg=“CNI down” cid=7d151f5f64b04c5cd4aca946fbb71803b394f219a229e24fc70231e673511954 networkMode=ipsec
06/04/2018 09:46:43time=“2018-04-06T07:46:43Z” level=info msg=“Setting up resolv.conf for ContainerId [7df8287617130c36243026aab4b397268c419f659261610e594b4290fc818662]”
06/04/2018 09:46:43time=“2018-04-06T07:46:43Z” level=info msg=“CNI up” cid=7df8287617130c36243026aab4b397268c419f659261610e594b4290fc818662 networkMode=ipsec
06/04/2018 09:46:43time=“2018-04-06T07:46:43Z” level=info msg=“CNI up done” cid=7df8287617130c36243026aab4b397268c419f659261610e594b4290fc818662 networkMode=ipsec result=IP4:{IP:{IP:10.42.236.71 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:48:04net.ipv4.conf.docker0.route_localnet = 1
06/04/2018 09:48:26time=“2018-04-06T07:48:26Z” level=info msg=“CNI down” cid=7df8287617130c36243026aab4b397268c419f659261610e594b4290fc818662 networkMode=ipsec
06/04/2018 09:48:43time=“2018-04-06T07:48:43Z” level=info msg=“Setting up resolv.conf for ContainerId [bdc156a2b6e1e2291d64b4f314d4067a7b7918cb0e8d193b442db3333196ad73]”
06/04/2018 09:48:43time=“2018-04-06T07:48:43Z” level=info msg=“CNI up” cid=bdc156a2b6e1e2291d64b4f314d4067a7b7918cb0e8d193b442db3333196ad73 networkMode=ipsec
06/04/2018 09:48:44time=“2018-04-06T07:48:44Z” level=info msg=“CNI up done” cid=bdc156a2b6e1e2291d64b4f314d4067a7b7918cb0e8d193b442db3333196ad73 networkMode=ipsec result=IP4:{IP:{IP:10.42.79.191 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:55:15net.ipv4.conf.docker0.route_localnet = 1
06/04/2018 09:55:16time=“2018-04-06T07:55:16Z” level=info msg=“CNI down” cid=bdc156a2b6e1e2291d64b4f314d4067a7b7918cb0e8d193b442db3333196ad73 networkMode=ipsec
06/04/2018 09:55:29time=“2018-04-06T07:55:29Z” level=info msg=“Setting up resolv.conf for ContainerId [6d72aaad9e24cb6e286b4af631a22f4b0eab6e03ea941530b30f7bf7058c7b78]”
06/04/2018 09:55:29time=“2018-04-06T07:55:29Z” level=info msg=“CNI up” cid=6d72aaad9e24cb6e286b4af631a22f4b0eab6e03ea941530b30f7bf7058c7b78 networkMode=ipsec
06/04/2018 09:55:29time=“2018-04-06T07:55:29Z” level=info msg=“CNI up done” cid=6d72aaad9e24cb6e286b4af631a22f4b0eab6e03ea941530b30f7bf7058c7b78 networkMode=ipsec result=IP4:{IP:{IP:10.42.162.72 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:56:10time=“2018-04-06T07:56:10Z” level=info msg=“CNI down” cid=6d72aaad9e24cb6e286b4af631a22f4b0eab6e03ea941530b30f7bf7058c7b78 networkMode=ipsec
06/04/2018 09:56:14time=“2018-04-06T07:56:14Z” level=info msg=“Setting up resolv.conf for ContainerId [092ba089ed881f4ae6438f78bf5dde1a8dd0a6098ba0473d16d1e463ceee8723]”
06/04/2018 09:56:14time=“2018-04-06T07:56:14Z” level=info msg=“CNI up” cid=092ba089ed881f4ae6438f78bf5dde1a8dd0a6098ba0473d16d1e463ceee8723 networkMode=ipsec
06/04/2018 09:56:14time=“2018-04-06T07:56:14Z” level=info msg=“CNI up done” cid=092ba089ed881f4ae6438f78bf5dde1a8dd0a6098ba0473d16d1e463ceee8723 networkMode=ipsec result=IP4:{IP:{IP:10.42.220.20 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 09:57:29time=“2018-04-06T07:57:29Z” level=info msg=“CNI down” cid=092ba089ed881f4ae6438f78bf5dde1a8dd0a6098ba0473d16d1e463ceee8723 networkMode=ipsec
06/04/2018 09:57:44time=“2018-04-06T07:57:44Z” level=info msg=“Setting up resolv.conf for ContainerId [45061ef71ba8eb702af9970fa153aa71a420725d35cdce71532a7b8f67701572]”
06/04/2018 09:57:44time=“2018-04-06T07:57:44Z” level=info msg=“CNI up” cid=45061ef71ba8eb702af9970fa153aa71a420725d35cdce71532a7b8f67701572 networkMode=ipsec
06/04/2018 09:57:44time=“2018-04-06T07:57:44Z” level=info msg=“CNI up done” cid=45061ef71ba8eb702af9970fa153aa71a420725d35cdce71532a7b8f67701572 networkMode=ipsec result=IP4:{IP:{IP:10.42.231.123 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:03:47net.ipv4.conf.docker0.route_localnet = 1
06/04/2018 10:03:48time=“2018-04-06T08:03:48Z” level=info msg=“CNI down” cid=45061ef71ba8eb702af9970fa153aa71a420725d35cdce71532a7b8f67701572 networkMode=ipsec
06/04/2018 10:03:59time=“2018-04-06T08:03:59Z” level=info msg=“Setting up resolv.conf for ContainerId [7d0aa535329208477760b6e6be0a240e841b8066df17a70321b8dcab46c4345a]”
06/04/2018 10:03:59time=“2018-04-06T08:03:59Z” level=info msg=“CNI up” cid=7d0aa535329208477760b6e6be0a240e841b8066df17a70321b8dcab46c4345a networkMode=ipsec
06/04/2018 10:03:59time=“2018-04-06T08:03:59Z” level=info msg=“CNI up done” cid=7d0aa535329208477760b6e6be0a240e841b8066df17a70321b8dcab46c4345a networkMode=ipsec result=IP4:{IP:{IP:10.42.160.188 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:04:30time=“2018-04-06T08:04:30Z” level=info msg=“CNI down” cid=7d0aa535329208477760b6e6be0a240e841b8066df17a70321b8dcab46c4345a networkMode=ipsec
06/04/2018 10:04:44time=“2018-04-06T08:04:44Z” level=info msg=“Setting up resolv.conf for ContainerId [3e4fd4273fa40b1d553793654561bf7cc789fa5e6d550b0254cb0c969b48801f]”
06/04/2018 10:04:44time=“2018-04-06T08:04:44Z” level=info msg=“CNI up” cid=3e4fd4273fa40b1d553793654561bf7cc789fa5e6d550b0254cb0c969b48801f networkMode=ipsec
06/04/2018 10:04:44time=“2018-04-06T08:04:44Z” level=info msg=“CNI up done” cid=3e4fd4273fa40b1d553793654561bf7cc789fa5e6d550b0254cb0c969b48801f networkMode=ipsec result=IP4:{IP:{IP:10.42.37.202 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:05:24time=“2018-04-06T08:05:24Z” level=info msg=“CNI down” cid=3e4fd4273fa40b1d553793654561bf7cc789fa5e6d550b0254cb0c969b48801f networkMode=ipsec
06/04/2018 10:05:31time=“2018-04-06T08:05:31Z” level=info msg=“Setting up resolv.conf for ContainerId [55d58870a66e0c491c8e0e7a4648f904a8f13cc2a5ea330bbb2260066fac782c]”
06/04/2018 10:05:31time=“2018-04-06T08:05:31Z” level=info msg=“CNI up” cid=55d58870a66e0c491c8e0e7a4648f904a8f13cc2a5ea330bbb2260066fac782c networkMode=ipsec
06/04/2018 10:05:31time=“2018-04-06T08:05:31Z” level=info msg=“CNI up done” cid=55d58870a66e0c491c8e0e7a4648f904a8f13cc2a5ea330bbb2260066fac782c networkMode=ipsec result=IP4:{IP:{IP:10.42.144.68 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:06:27time=“2018-04-06T08:06:27Z” level=info msg=“CNI down” cid=55d58870a66e0c491c8e0e7a4648f904a8f13cc2a5ea330bbb2260066fac782c networkMode=ipsec
06/04/2018 10:06:45time=“2018-04-06T08:06:45Z” level=info msg=“Setting up resolv.conf for ContainerId [e3c79ab9feb2d60b206e76a671f64e43231dd5416ef9a214494a4b84a5bb3a35]”
06/04/2018 10:06:45time=“2018-04-06T08:06:45Z” level=info msg=“CNI up” cid=e3c79ab9feb2d60b206e76a671f64e43231dd5416ef9a214494a4b84a5bb3a35 networkMode=ipsec
06/04/2018 10:06:45time=“2018-04-06T08:06:45Z” level=info msg=“CNI up done” cid=e3c79ab9feb2d60b206e76a671f64e43231dd5416ef9a214494a4b84a5bb3a35 networkMode=ipsec result=IP4:{IP:{IP:10.42.11.213 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:07:39time=“2018-04-06T08:07:39Z” level=info msg=“CNI down” cid=e3c79ab9feb2d60b206e76a671f64e43231dd5416ef9a214494a4b84a5bb3a35 networkMode=ipsec
06/04/2018 10:08:01time=“2018-04-06T08:08:01Z” level=info msg=“Setting up resolv.conf for ContainerId [2a0688ff53846c6492f5c91216e71e3a440ab5e97632792192260d05f8a20235]”
06/04/2018 10:08:01time=“2018-04-06T08:08:01Z” level=info msg=“CNI up” cid=2a0688ff53846c6492f5c91216e71e3a440ab5e97632792192260d05f8a20235 networkMode=ipsec
06/04/2018 10:08:01time=“2018-04-06T08:08:01Z” level=info msg=“CNI up done” cid=2a0688ff53846c6492f5c91216e71e3a440ab5e97632792192260d05f8a20235 networkMode=ipsec result=IP4:{IP:{IP:10.42.254.255 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:12:32net.ipv4.conf.docker0.route_localnet = 1
06/04/2018 10:12:32time=“2018-04-06T08:12:32Z” level=info msg=“CNI down” cid=2a0688ff53846c6492f5c91216e71e3a440ab5e97632792192260d05f8a20235 networkMode=ipsec
06/04/2018 10:12:45time=“2018-04-06T08:12:45Z” level=info msg=“Setting up resolv.conf for ContainerId [99b4ecceb68c962e0cd772331a3d4c271b1b9c040c58e90430be6e83d067b10b]”
06/04/2018 10:12:45time=“2018-04-06T08:12:45Z” level=info msg=“CNI up” cid=99b4ecceb68c962e0cd772331a3d4c271b1b9c040c58e90430be6e83d067b10b networkMode=ipsec
06/04/2018 10:12:45time=“2018-04-06T08:12:45Z” level=info msg=“CNI up done” cid=99b4ecceb68c962e0cd772331a3d4c271b1b9c040c58e90430be6e83d067b10b networkMode=ipsec result=IP4:{IP:{IP:10.42.34.34 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:13:10time=“2018-04-06T08:13:10Z” level=info msg=“CNI down” cid=99b4ecceb68c962e0cd772331a3d4c271b1b9c040c58e90430be6e83d067b10b networkMode=ipsec
06/04/2018 10:13:30time=“2018-04-06T08:13:30Z” level=info msg=“Setting up resolv.conf for ContainerId [ff68b06822b65f618f59cf9d0df9457c208aa97fd7d90603b58bffc3d0748821]”
06/04/2018 10:13:30time=“2018-04-06T08:13:30Z” level=info msg=“CNI up” cid=ff68b06822b65f618f59cf9d0df9457c208aa97fd7d90603b58bffc3d0748821 networkMode=ipsec
06/04/2018 10:13:30time=“2018-04-06T08:13:30Z” level=info msg=“CNI up done” cid=ff68b06822b65f618f59cf9d0df9457c208aa97fd7d90603b58bffc3d0748821 networkMode=ipsec result=IP4:{IP:{IP:10.42.187.171 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:14:19time=“2018-04-06T08:14:19Z” level=info msg=“CNI down” cid=ff68b06822b65f618f59cf9d0df9457c208aa97fd7d90603b58bffc3d0748821 networkMode=ipsec
06/04/2018 10:14:32time=“2018-04-06T08:14:32Z” level=info msg=“Setting up resolv.conf for ContainerId [a645dfefee9f186ad7efeffffd97d2157eaf6ae7fd42456d7c57cd6c56f2db1b]”
06/04/2018 10:14:32time=“2018-04-06T08:14:32Z” level=info msg=“CNI up” cid=a645dfefee9f186ad7efeffffd97d2157eaf6ae7fd42456d7c57cd6c56f2db1b networkMode=ipsec
06/04/2018 10:14:32time=“2018-04-06T08:14:32Z” level=info msg=“CNI up done” cid=a645dfefee9f186ad7efeffffd97d2157eaf6ae7fd42456d7c57cd6c56f2db1b networkMode=ipsec result=IP4:{IP:{IP:10.42.83.2 Mask:ffff0000} Gateway:10.42.0.1 Routes:[{Dst:{IP:169.254.169.250 Mask:ffffffff} GW:} {Dst:{IP:0.0.0.0 Mask:00000000} GW:10.42.0.1}]}, DNS:{Nameservers: Domain: Search: Options:}
06/04/2018 10:15:43time=“2018-04-06T08:15:43Z” level=info msg=“CNI down” cid=a645dfefee9f186ad7efeffffd97d2157eaf6ae7fd42456d7c57cd6c56f2db1b networkMode=ipsec
We don’t understand why. We imagine that’s why the container status goes frequently to “Degraded”.