Https latency problem - loadbalancer haproxy

howdy!

I faced the issue, that from 9am to 9pm I have the latency problem connecting to my services.
The problem happened only with https connections - TLS. I use a loadbalancer rancher/lb-service-haproxy:v0.9.6 Do you have any idea how to troubleshoot the issue?

Thanks for any idea,
Maciej