How to Alert based on Slope of Metric Graph?

Grafana Alerting
, ,
1

I have an SQS Dead Letter Queue I am trying to alert on.
Grafana is getting the data about this queue from Cloudwatch via the Cloudwatch connector.

The queue’s behavior over the past week looks like this:

image
image1570×248 13.4 KB

I am trying to configure an alert which fires whenever the slope of this queue is not negative.
How would I do that?

I saw this post before which uses the diff() operator in the expression but that approach doesn’t seem possible anymore in Grafana 9 (I can’t make the query a range, I can only select the series “A”)

2

I use InfluxDB and have a similar need and found this to be perfect.

3

What if I don’t use InfluxDB? Is it possible to do something like rate based alerting using Math expressions?

4

I do not think the built in math functions in Grafana allow one to alert on the rate of change (slope) of a time series. Best to go to the tools offered by your datasource.

5

Ah ok. Is it possible for that to be added to Grafana in the future? Rate of change based alerting seems like a pretty basic ask.

6

Feature requests can be started here: