I’m trying get a notification whenever I have an error in my logs (from Loki). I’ve set up a rule that seems to be doing exactly what I want, and when I hit the Preview button, it shows a red Firing label (first picture). Promising!
However, when I look at it in the Alert rules view, it’s always at Normal, and I never get notified. (Second picture) I’ve been stumped for a while; what am I doing wrong?
welcome @pozwhwitmegqhjesqslg
in the rule details how do the every and for part look like?
also, could you please increase the the Grafana logs to debug and note any errors ?
Thanks for you reply, @antonio.
The every and for part are 1m each if I understand it correctly, see below. The grafana instance is managed, so I don’t have access to that at the moment, but I’ll see what I can do.
what happens if you change the for to 0s ? Afterwards, check the state history (in Alert list > select your rule > click View rule icon)
It still doesn’t fire and I don’t see anything in the alert history (after having 0s for some time). However, interestingly, I see it shows as “Firing” at the bottom of the view, but “Normal” at the top. Is there some kind of hysteresis that prevents it from triggering? That is, does it need to go to normal before it can trigger? One thing that speaks against that theory is that I do have another alert that goes back and forth between triggers, but still doesn’t show anything.
