Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Azure Service Bus: Best way to implement exponential retry policy for failed to process messages

I am continuously receiving messages in peek mode and abandoning them if processing fails (Not the delivery). However, the message immediately becomes available again and is received for processing again. It fails quickly again and after max deliveries it is dead-lettered.

Is there a way to configure the topic/subscription to wait before releasing the message after it is abandoned? Preferably in exponential manner.

Of course I am open for suggestions via the code as well.

like image 679
dvitonis Avatar asked Sep 15 '17 12:09

dvitonis


1 Answers

There is not a way to set an exponential back-off in the Service Bus configuration. I've experienced the same issue, and have done the following:

  1. Dequeue the message, and marked the message as received.
  2. Perform processing within a try/catch block. If there is an exception, enqueue a new message with a scheduled delivery at a certain point in the future.

We've wrapped our Service Bus Message Queue payload in a class that specifies the number of delivery attempts. We multiply the number of delivery attempts times a constant, then add that number to the current dateTime for scheduled delivery in the future. After the number of delivery attempts that we want to try are exceeded, we explicitly dead letter the message.

Edit 7-17-2020 Consider using Azure Durable Task Framework which has a customizable retry policy built right in.

like image 182
Rob Reagan Avatar answered Oct 22 '22 12:10

Rob Reagan