I’d like to be able to add some more information to our alerts so that we can better process them with the tool that we use to handle alerts.
For example, lets say we have an alert that is triggering on an error from one of our kubernetes pods. This is easy enough to alert on but what if I wanted to add some things into the alert message such as the namespace this pod was running on, or maybe the node that it’s on. Is this possible?
I did find this:
which looks like what I want to do, or at least in the right direction but that doesn’t mention anything at all about where those labels come from or how they get created.