Problems after removing node from imported cluster, Failed to communicate with API server: Get waiting for cluster agent to connect

I’m setting up a cluster using RKE which then gets imported into Rancher, however whenever we remove a node from the imported cluster then rancher UI says that the cluster is unavailable eventhough everything is OK with the cluster. See the screenshot below.

Is there anyway to tell the Rancher UI to stop looking for the removed node?