Containers become unresponsive

So I have two containers:

Load balancer

Nginx website

I scale these on to two hosts, host a and host b.

If I shutdown host b, the load balancer on host a becomes unresponsive for about a minute or so. Why is the load balancer on host a being affected?