What is the maximum size that a message can be when publishing to a RabbitMQ queue (pub/sub model) ?
I can't see any explicit limits in the docs but I assume there are some guidelines.
Thanks in advance.
Number of queues Queues are single-threaded in RabbitMQ, and one queue can handle up to about 50 thousand messages.
Every RabbitMQ node has a data directory that stores all the information that resides on that node. A data directory contains two types of data: definitions (metadata, schema/topology) and message store data.
The Consumer Capacity MetricIt helps the operator notice conditions where it may be worthwhile adding more consumers (application instances) to the queue. If this number is less than 100%, the queue leader replica may be able to deliver messages faster if: There were more consumers or.
I was doing comparison between Amazon Queue Service and RabbitMQ or other streaming+messaging platforms like kinesis, kafka. As Amazon Queue Service only supports min 2^10 bytes(1 Kilobytes)
- max 2^18 bytes (256 Kilobytes)
, similarly kinesis has size limits too. (Don't know why?)
Anyway In theory AMQueueProtocal would handle 2^64 bytes
. So, even for a huge message, RabbitMQ might work in a single broker, definitely taking minutes/hours to persist but would or might not in a cluster of brokers. If the message transfer time between nodes (60seconds?) > heartbeat time between nodes
, it will cause the cluster to disconnect and the loose the message.
This thread is useful -> Can RabbitMQ handle big messages?
http://grokbase.com/t/rabbitmq/rabbitmq-discuss/127wsy1h92/limiting-the-size-of-a-message
http://comments.gmane.org/gmane.comp.networking.rabbitmq.general/14665
http://rabbitmq.1065348.n5.nabble.com/Max-messages-allowed-in-a-queue-in-RabbitMQ-td26063.html
https://www.rabbitmq.com/heartbeats.html
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With