Best Practice for updating Prometheus Alerts

Hello,

I am new to Rancher (and K8s in general) and trying to wade through all the information to get the best practice for updating & managing Prometheus Rules within a Rancher environment. More specifically, the alerts that bundled with the kube-prometheus-stack helm chart.

For example, if we want to increase the threshold of an alert that is firing for high cpu or memory etc is this something that can be adjusted through the Rancher UI or do we have to redeploy with a custom helm chart, or something else all together?

I have read through the monitoring section of the Rancher site but it appears to be aimed towards initial setup.

Apologies if this is not the correct forum section, any guidance would be appreciated.