[rabbitmq-discuss] RabbitMQ, Celery and Django Celery not playing well together.. solution found!

Thu Aug 19 13:07:50 BST 2010

Hey again,

Great news! It's all now working :) This is the combination of items I had
to use in the end:

*Erlang: *Erlang R14A (erts-5.8) [source] [64-bit] [smp:2:2] [rq:2]
[async-threads:0] [hipe] [kernel-poll:false]
*Python Celery: *celery-2.0.2-py2.6
*Python Django Celery: *django_celery-2.0.2-py2.6
*Python Django: *Django-1.2.1-py2.6
*RabbitMQ:* Latest as of 18th August 2010 (AMQP 0-9-1 / 0-9 / 0-8)

Also, this next bit is slightly off topic but, to make the latest version of
RabbitMQ work nicely with Celery, the set_permissions method stated in the
documentation of Celery is wrong..

*Correct:* ./rabbitmqctl set_permissions -p vhost username ".*" ".*" ".*"
*Wrong:* ./rabbitmqctl set_permissions -p vhost username "" ".*" ".*"

I really hope this helps someone, as it's taken me 2-3 days to figure this
out.

Thanks again to Matthew for pointing out the re:split problem!

Cheers

Cal

On Thu, Aug 19, 2010 at 12:53 PM, Cal Leeming [Simplicity Media Ltd] <
cal.leeming at simplicitymedialtd.co.uk> wrote:

> Hi again,
>
> Looks like you were right Matthew. It would seem V5.6.3 is no
> longer adequate for RabbitMQ to function properly. For anyone else who runs
> into this problem with Celery/Django Celery along side RabbitMQ, you have to
> make sure you are running a newer version of Erlang (I'm now using 5.8)
> along with the latest export of RabbitMQ.
>
> I'll let you know if this resolves all the bugs..
>
> Cheers
>
> Cal
>
>  root at mail01.dmemedialtd.com [~] > erl
> Erlang (BEAM) emulator version 5.6.3 [source] [64-bit] [smp:2]
> [async-threads:0] [kernel-poll:false]
>
> Eshell V5.6.3  (abort with ^G)
> 1> re:split("Erlang","[ln]",[{return,list}]).
> ** exception error: undefined function re:split/3
>
>  root at mail01.dmemedialtd.com [~/otp_src_R14A] > ./bin/erl
> Erlang R14A (erts-5.8) [source] [64-bit] [smp:2:2] [rq:2] [async-threads:0]
> [hipe] [kernel-poll:false]
>
> Eshell V5.8  (abort with ^G)
> 1> re:split("Erlang","[ln]",[{return,list}]).
> ["Er","a","g"]
> 2>
>
>
>
> On Thu, Aug 19, 2010 at 12:51 PM, Cal Leeming [Simplicity Media Ltd] <
> cal.leeming at simplicitymedialtd.co.uk> wrote:
>
>> Hey guys,
>>
>> Looks like I found the offending change.. I'm attempting to compile a
>> newer version of Erlang now to see if this resolves the problem.
>>
>>
>>
>> src/rabbit_exchange_type_topic.erl
>>
>>
>> branchbug23138
>>
>> changeset 45136c99455ffbc1 <http://hg.rabbitmq.com/rabbitmq-server/rev/6c99455ffbc1>
>> parent 3982
>> ce8aaaaaa101 <http://hg.rabbitmq.com/rabbitmq-server/diff/ce8aaaaaa101/src/rabbit_exchange_type_topic.erl>
>>
>>        1 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l1> --- a/src/rabbit_exchange_type_topic.erl	Fri Jul 09 12:59:30 2010 +0100       2 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l2> +++ b/src/rabbit_exchange_type_topic.erl	Thu Aug 19 12:28:48 2010 +0100       3 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l3> @@ -67,8 +67,7 @@       4 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l4>                            Delivery).       5 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l5>         6 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l6>  split_topic_key(Key) ->       7 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l7> -    KeySplit = re:split(Key, "\\.", [{return, list}]),       8 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l8> -    KeySplit.       9 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l9> +    re:split(Key, "\\.", [{return, list}]).      10 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l10>        11 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l11>  topic_matches(PatternKey, RoutingKey) ->      12 <http://hg.rabbitmq.com/rabbitmq-server/diff/6c99455ffbc1/src/rabbit_exchange_type_topic.erl#l12>      P = split_topic_key(PatternKey),
>>
>>
>> On Thu, Aug 19, 2010 at 1:56 AM, Cal Leeming [Simplicity Media Ltd] <
>> cal.leeming at simplicitymedialtd.co.uk> wrote:
>>
>>>
>>>
>>> ---------- Forwarded message ----------
>>> From: Cal Leeming [Simplicity Media Ltd] <
>>> cal.leeming at simplicitymedialtd.co.uk>
>>> Date: Thu, Aug 19, 2010 at 1:56 AM
>>> Subject: Re: [rabbitmq-discuss] Problems with RabbitMQ not responding on
>>> channel request
>>> To: "Cal Leeming [Simplicity Media Ltd]" <
>>> cal.leeming at simplicitymedialtd.co.uk>,
>>> rabbitmq-discuss at lists.rabbitmq.com
>>>
>>>
>>> Hey Matthew,
>>>
>>> As far as I know, there is only a single instance of Erlang installed on
>>> the server.
>>>
>>> However, I think it's safe to assume that I am probably doing something
>>> wrong when compiling the RabbitMQ from scratch, so I'm going to have another
>>> play around and see if I can figure out what is happening.
>>>
>>> Thank you for all your help :)
>>>
>>> Cal
>>>
>>> On Thu, Aug 19, 2010 at 1:42 AM, Matthew Sackman <matthew at rabbitmq.com>wrote:
>>>
>>>> On Thu, Aug 19, 2010 at 01:36:33AM +0100, Cal Leeming [Simplicity Media
>>>> Ltd] wrote:
>>>> > Also, now that I reverted back to the original RabbitMQ (1.8.1-1), the
>>>> re
>>>> > bug disappears...
>>>>
>>>> That's very odd - as far as I'm aware, there are no changes between
>>>> 1.8.1 and default regarding the use of regexp versus the re module (the
>>>> re module is the replacement for the new deprecated regexp module). I
>>>> wonder if this points more to different multiple versions of erlang
>>>> installed on your system - thus when you run and compile rabbit from
>>>> source it picks up something different to if you use the binary. Any
>>>> chance of that happening?
>>>>
>>>> I would have thought a ps ax | grep rabbit for each case should be
>>>> enough to see what's different.
>>>>
>>>> Matthew
>>>>
>>>
>>>
>>>
>>> --
>>>
>>> Cal Leeming
>>>
>>> Operational Security & Support Team
>>>
>>> *Out of Hours: *+44 (07534) 971120 | *Support Tickets: *
>>> support at simplicitymedialtd.co.uk
>>> *Fax: *+44 (02476) 578987 | *Email: *
>>> cal.leeming at simplicitymedialtd.co.uk
>>> Simplicity Media Ltd. All rights reserved.
>>> Registered company number 7143564
>>>
>>>
>>>
>>>
>>> --
>>>
>>> Cal Leeming
>>>
>>> Operational Security & Support Team
>>>
>>> *Out of Hours: *+44 (07534) 971120 | *Support Tickets: *
>>> support at simplicitymedialtd.co.uk
>>> *Fax: *+44 (02476) 578987 | *Email: *
>>> cal.leeming at simplicitymedialtd.co.uk
>>> Simplicity Media Ltd. All rights reserved.
>>> Registered company number 7143564
>>>
>>>
>>
>>
>> --
>>
>> Cal Leeming
>>
>> Operational Security & Support Team
>>
>> *Out of Hours: *+44 (07534) 971120 | *Support Tickets: *
>> support at simplicitymedialtd.co.uk
>> *Fax: *+44 (02476) 578987 | *Email: *cal.leeming at simplicitymedialtd.co.uk
>>
>> Simplicity Media Ltd. All rights reserved.
>> Registered company number 7143564
>>
>>
>
>
> --
>
> Cal Leeming
>
> Operational Security & Support Team
>
> *Out of Hours: *+44 (07534) 971120 | *Support Tickets: *
> support at simplicitymedialtd.co.uk
> *Fax: *+44 (02476) 578987 | *Email: *cal.leeming at simplicitymedialtd.co.uk
> Simplicity Media Ltd. All rights reserved.
> Registered company number 7143564
>
>

-- 

Cal Leeming

Operational Security & Support Team

*Out of Hours: *+44 (07534) 971120 | *Support Tickets: *
support at simplicitymedialtd.co.uk
*Fax: *+44 (02476) 578987 | *Email: *cal.leeming at simplicitymedialtd.co.uk
Simplicity Media Ltd. All rights reserved.
Registered company number 7143564
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20100819/de23ed44/attachment.htm>