[rabbitmq-discuss] Rabbitmq With Celery Problem, Error 541

[Ask Solem]

Maybe you should try enabling the pool.  Either way it should retry publishing the result, so maybe this is yet another corner case in amqplib.  It would be great if you could try to create a small test case that is able to reproduce the issue.

-- 
Ask Solem

On Nov 18, 2011, at 1:15 PM, Mike Grouchy <mgrouchy at gmail.com> wrote:

> 
> 
> On 2011-11-18, at 8:09 AM, Ask Solem <ask at rabbitmq.com> wrote:
> 
>> 
>> On 18 Nov 2011, at 01:27, Mike Grouchy wrote:
>> 
>>> Hi There,
>>> 
>>> I'm having this issue where I have a script that runs on a cronjob
>>> that runs a rather large amount of tasks against celery(around 60K or
>>> so tasks). It seems like after I get through a large portion of the
>>> tasks I start getting error 541's returned from the celery workers
>>> which seems to be bubbling up from rabbitmq.
>>> 
>>> Here is the relevant portion of the log https://gist.github.com/c92d42929e514cbb69fa
>>> 
>>> The weird thing is I am not seeing any error in the rabbitmq logs, but
>>> as far as I know the error is coming from rabbitmq.
>>> 
>>> Can anyone point me in the direction on what I can do to prevent this
>>> from continuing to happen?
>>> 
>>> 
>> 
>> Seems to me like you have lost the connection to RabbitMQ while trying
>> to publish task results.
>> 
>> Are you using BROKER_POOL_LIMIT?
> 
> No. Currently just the defaults.