[rabbitmq-discuss] Can RabbitMQ handle big messages?

[Zabrane Mickael]

Hi guys,

Before trying to rewrite the wheel, anyone faced this problem before and would like to
share some code (ie. splitting a big file are constructing it when reading from RabbitMQ queue)?

Thanks ...

Regards,
Zabrane


On Mar 10, 2012, at 7:34 PM, Jerry Kuch wrote:

> Hi, Zabrane:  In theory the AMQP protocol IIRC allows crazy large message payloads (2^64 bytes I believe).  In practice though, that's madness since you end up with potential copying and buffering along the way that could make a broker very unhealthy.
> 
> For moving bulk binary data as in your app, you'd be wise to fragment at the producer and reassemble at the destination/consumer. Keeping your chunks in the 100KB range might be a decent place to start experimenting.  
> 
> Sent from my iPhone (Brevity and typos are hopefully the result of 1-fingered typing rather than rudeness or illiteracy).
> 
> 
> On Mar 10, 2012, at 10:28 AM, Zabrane Mickael <zabrane3 at gmail.com> wrote:
> 
>> Hi there,
>> 
>> I've a set (~1 million) of high resolution PNG files  each one between 100MB and 1GB size.
>> I'd like to know if RabbitMQ is capable of handling such files as messages?
>> 
>> What's the max allowed message size?
>> 
>> Thx ...
>> 
>> Regards,
>> Zabrane
>> 
>> _______________________________________________
>> rabbitmq-discuss mailing list
>> rabbitmq-discuss at lists.rabbitmq.com
>> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20120312/c278c47d/attachment.htm>