Rancher network failing when using static internal routes


I am trying to achieve the following scenario.

I got rancher hosts which are located on an internal network, all have public IP’s which they are reachable.
The rancher (IPSec) network is using their public IP’s since I want to be able to add host which are not part of the internal network.

This works fine.

The Problem arises when I try to route the traffic to from the hosts internally bypassing and use the internal network instead if the hosts are attached to it.

The host can still ping each other but the on the rancher level networking stops working and the health check can’t ping the other health checker.

ip route add “Public IP”/32 via "Internal IP"
ip route add “Public IP”/32 via “Internal IP” src “Public IP”

Does anyone have an idea what I need to do in order to get it working?

In my research, I have come to the conclusion that this probably has to do with IPSec preventing communications since it is landing on an interface which does not have the right IP. Google has stopped producing good answers for this question :confused:

Help is really welcome.

Kind regards