[rabbitmq-discuss] rabbitmq-server crashes hard while consuming 31GB of RAM

Thu Nov 24 14:03:52 GMT 2011

On 11/24/2011 02:13 PM, Ask Solem wrote:
> 
> On 23 Nov 2011, at 15:05, Muharem Hrnjadovic wrote:
> 
>> On 11/23/2011 11:43 AM, Matthias Radestock wrote:
>>>
>>>> 99.9% of the queues are celery task queues and contain 0 or 1 messages;
>>>> the main celery task queue contains up to 4096 messages.
> 
> I would guess that the queues that contain 0 or 1 messages are not
> task queues but result queues, right?
You are right, I meant the result queues.

> 
> 6700 queues are not *that* many though, but it depends on the size of
> the result.
> How large are these result messages?
The messages are strings like these:
    '::JOB::635::!hazard_curve_poes!0!-8684302006989106665'

While looking at the code again it occurred at me that the results
returned by the workers *are* actually ignored i.e. we can afford to
use the

    ignore_result=True

parameter setting in the @task decorator. Will try that and see how far
I get.

Best regards/Mit freundlichen Grüßen

-- 
Muharem Hrnjadovic <mh at foldr3.com>
Public key id   : B2BBFCFC
Key fingerprint : A5A3 CC67 2B87 D641 103F  5602 219F 6B60 B2BB FCFC

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 900 bytes
Desc: OpenPGP digital signature
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111124/bf8cd0f2/attachment.pgp>