[rabbitmq-discuss] rabbitmq-server crashes hard while consuming 31GB of RAM

Wed Nov 23 15:05:47 GMT 2011

On 11/23/2011 11:43 AM, Matthias Radestock wrote:
> Muharem,
> 
> On 23/11/11 10:30, Muharem Hrnjadovic wrote:
>> I am running a seismic calculation using python-celery (rev. 2.4.2, on
>> an ubuntu 11.04 server) and the number of task queues peaks at 6700.
>>
>> nevertheless rabbitmq-server (rev. 2.7.0) crashes approx. 2.5 hours into
>> the calculation having 3912 queues and consuming 31GB of RAM at that
>> point.
>>
>> 99.9% of the queues are celery task queues and contain 0 or 1 messages;
>> the main celery task queue contains up to 4096 messages.
>>
>> How do I figure out why rabbitmq is consuming that much RAM and why it's
>> crashing?
> 
> Post the output of 'rabbitmqctl report' when rabbit is getting close
> to eating that amount of memory.
Please see the "sudo rabbitmqctl report" link on:
    https://bugs.launchpad.net/openquake/+bug/894024/comments/1

>> there was nothing in the logs
> 
> Really? I would have expected to at least see a memory alarm. Unless
> you have enormous quantities of RAM and/or changed the thresholds.
The machine in question has 64GB of RAM. I did not change any
thresholds.

> Please post the logs.
Please see the "rabbitmq logs" link on:
    https://bugs.launchpad.net/openquake/+bug/894024/comments/2

Best regards/Mit freundlichen Grüßen

-- 
Muharem Hrnjadovic <mh at foldr3.com>
Public key id   : B2BBFCFC
Key fingerprint : A5A3 CC67 2B87 D641 103F  5602 219F 6B60 B2BB FCFC

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 900 bytes
Desc: OpenPGP digital signature
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111123/4f31bb45/attachment.pgp>