Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Azure Storage Queue - Retrieving hidden messages

Is there a way to retrieve azure storage queue messages that are hidden? Background - I have been searching for an app/cmdlet/third party tool that would let me backup the entire queue including hidden messages (for troubleshooting purposes) but unable to find one.

I have also considered writing a powershell script to download all messages, but couldn't find a way to retrieve hidden ones.

Help will be greatly appreciated!

like image 393
infinity Avatar asked Aug 11 '26 19:08

infinity


1 Answers

While I don't know if such a tool exists for Azure Storage Queues, have you considered Azure Service Bus Topics and Subscriptions for your queueing system? Under a topic and subscription model, you can set up the following architecture:

[Topic] Place messages on this queue. They get replicated to each subscription.
 [Subscription1] Your backup process reads this queue and persists messages.
 [Subscription2] Your application reads from this queue for normal operation.

This has a few benefits:

  • it decouples your backup and production systems, making it less likely that, for example, a faulty backup script ends up impacting production behavior
  • Locked ("hidden") messages apply only to the given subscription, so your backup queue will never have to deal with a message that is hidden or locked by the production queue.

Similar setups can certainly be achieved using storage queues, but Azure Service Bus has this sort of behavior built in.

like image 187
joshtkling Avatar answered Aug 14 '26 12:08

joshtkling



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!