I have 2 containers behind a load balancer and I’m only achieving 2000 req/sec. When I benchmark the containers directly, bypassing the load balancer, I achieve 20_000 req/sec per container.
The containers and the load balancer are running on separate (dedicated) hardware on Packet.net, have the same specs, and are in the same datacenter.
Any idea what might be causing this? The overlay network perhaps?