Hi everyone!
I have an application that provides me with Prometheus metrics that I use Grafana to monitor. One of these metrics is a Prometheus Counter() that increases with 1 every day somewhere between 4PM and 6PM.
I want to have an alert on this metric to make sure it has increased by 1 every day and alert me if not.
My first thought was to use the increase() function to see how much the counter has increased the last 24 hours. Like so: increase(metric_name[24h]). However, the problem with this solution is that the counter increases at different times. Making the graph jump to either 2 or 0 for short durations of time before stabilizingback to 1 again.
Any suggestions?