How to block access to Rancher via IP

I run Rancher on the same node as the Let’s Encrypt SSL certificate, but I can access Rancher via IP. Is it possible to block access via IP and leave it only through Doman?

Thanks!