[rabbitmq-discuss] Can RabbitMQ handle big messages?

[Josh Geisser]

No code avilable anymore but I used to test >=512MB messages, no problems at all.
(Except of coarse it takes ages to upload/download, and getting any %-complete is almost impossible)

Used py-AMQP then.

FYI & cheers
Josh

________________________________
Von: rabbitmq-discuss-bounces at lists.rabbitmq.com [mailto:rabbitmq-discuss-bounces at lists.rabbitmq.com] Im Auftrag von Zabrane Mickael
Gesendet: Montag, 12. März 2012 07:33
An: Jerry Kuch
Cc: rabbitmq-discuss at lists.rabbitmq.com
Betreff: Re: [rabbitmq-discuss] Can RabbitMQ handle big messages?

Hi guys,

Before trying to rewrite the wheel, anyone faced this problem before and would like to
share some code (ie. splitting a big file are constructing it when reading from RabbitMQ queue)?

Thanks ...

Regards,
Zabrane


On Mar 10, 2012, at 7:34 PM, Jerry Kuch wrote:


Hi, Zabrane:  In theory the AMQP protocol IIRC allows crazy large message payloads (2^64 bytes I believe).  In practice though, that's madness since you end up with potential copying and buffering along the way that could make a broker very unhealthy.

For moving bulk binary data as in your app, you'd be wise to fragment at the producer and reassemble at the destination/consumer. Keeping your chunks in the 100KB range might be a decent place to start experimenting.

Sent from my iPhone (Brevity and typos are hopefully the result of 1-fingered typing rather than rudeness or illiteracy).


On Mar 10, 2012, at 10:28 AM, Zabrane Mickael <zabrane3 at gmail.com<mailto:zabrane3 at gmail.com>> wrote:
Hi there,

I've a set (~1 million) of high resolution PNG files  each one between 100MB and 1GB size.
I'd like to know if RabbitMQ is capable of handling such files as messages?

What's the max allowed message size?

Thx ...

Regards,
Zabrane

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss at lists.rabbitmq.com<mailto:rabbitmq-discuss at lists.rabbitmq.com>
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss




--
----
ASG at hnet
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20120312/bf7dcf85/attachment.htm>