[rabbitmq-discuss] rabbitmq-server crashes hard while consuming 31GB of RAM

Wed Nov 23 10:43:38 GMT 2011

Muharem,

On 23/11/11 10:30, Muharem Hrnjadovic wrote:
> I am running a seismic calculation using python-celery (rev. 2.4.2, on
> an ubuntu 11.04 server) and the number of task queues peaks at 6700.
>
> nevertheless rabbitmq-server (rev. 2.7.0) crashes approx. 2.5 hours into
> the calculation having 3912 queues and consuming 31GB of RAM at that
> point.
>
> 99.9% of the queues are celery task queues and contain 0 or 1 messages;
> the main celery task queue contains up to 4096 messages.
>
> How do I figure out why rabbitmq is consuming that much RAM and why it's
> crashing?

Post the output of 'rabbitmqctl report' when rabbit is getting close to 
eating that amount of memory.

> there was nothing in the logs

Really? I would have expected to at least see a memory alarm. Unless you 
have enormous quantities of RAM and/or changed the thresholds. Please 
post the logs.

Regards,

Matthias.