Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Azure alert only fired once

I have implemented an Azure alert that should fire when a Application Insights metric is greater than zero. The metric is the number of items in a Azure poison queue. The metric is calculated by a Azure Function described in this article: https://www.scaling-to-the-sky.com/2018/03/08/poison-queue-monitoring-with-azure-functions/?unapproved=160&moderation-hash=072116753136d2008f5e63a856d8e4b0#comment-160.

The alert has only fired once despite the condition being met on several occasions. I don't know why it doesn't fire. I have noticed that on the one alert that was fired the monitor condition has never changed from "Fired" to "Resolved". Maybe that is the reason why no need new alerts are fired? If that is the case then how do I change the state of the alert monitor condition?

Application Insight custom log

enter image description here

like image 604
AndersBaumann Avatar asked Nov 23 '19 16:11

AndersBaumann


1 Answers

A metric alert that's in a "Fired" state would not trigger again until it's resolved. This is done to reduce noise. Resolution happens automatically after 3 healthy evaluations of your condition (evaluations where the condition isn't breached), and there's no way to manually change the monitor condition to "Resolved".

Can you please confirm if you are sending a metric value on every evaluation of the poison queue, even if the value is 0?

like image 152
Harel Broitman Avatar answered Nov 11 '22 22:11

Harel Broitman