[rabbitmq-discuss] Management UI plugin issue on 2 node cluster

[Jos Boumans]

Hi Aaron,

On 19 Apr 2011, at 06:07, Aaron Westendorf wrote:

> Do you have a lot of traffic on your cluster? We were stress testing
> and found the UI plugin rapidly consuming CPU and RAM even though we
> weren't sending any traffic to its node. Eventually the kernel killed
> the process, which is what I'm seeing implied in your logs.

A few requests per second at best; we're just gearing up to use rabbit
in production and basically just the messages for the monitoring system
are flowing through there right now.

No real load to speak of to be honest.

>
> I've been meaning to write up a bug report but we've been really busy
> gearing up for todays big launch of Mortal Kombat.
>
> -Aaron
>
> On Tue, Apr 19, 2011 at 7:45 AM, Matthias Radestock
> <matthias at rabbitmq.com> wrote:
>> Jos,
>>
>> Jos Boumans wrote:
>>>
>>> On 18 Apr 2011, at 16:43, Matthias Radestock wrote:
>>>>
>>>> Is there anything of note in the rabbit.log and rabbit-sasl.log?
>>>
>>> Nothing stood out before, but looking again i see:
>>>
>>> =WARNING REPORT==== 16-Apr-2011::21:55:15 ===
>>> Mnesia('rabbit at rabbit-a002'): ** WARNING ** Mnesia is overloaded:
>>> {dump_log,
>>>
>>> time_threshold}
>>>
>>> =WARNING REPORT==== 16-Apr-2011::21:55:15 ===
>>> Mnesia('rabbit at rabbit-a002'): ** WARNING ** Mnesia is overloaded:
>>> {dump_log,
>>>
>>> time_threshold}
>>>
>>> =ERROR REPORT==== 16-Apr-2011::21:55:15 ===
>>> Mnesia('rabbit at rabbit-a002'): ** ERROR ** mnesia_event got
>>> {inconsistent_database, running_partitioned_network,  
>>> 'rabbit at rabbit-a001'}
>>>
>>> And from the sasl log:
>>>
>>> =CRASH REPORT==== 9-Apr-2011::03:24:03 ===
>>>  crasher:
>>>    initial call: gen:init_it/6
>>>    pid: <0.158.0>
>>>    registered_name: []
>>>    exception exit: {unexpected_info,
>>>                        {mnesia_locker,'rabbit at rabbit-a001',granted}}
>>>      in function  gen_server2:terminate/3
>>>    ancestors: [worker_pool_sup,rabbit_sup,<0.109.0>]
>>>    messages: []
>>>    links: [<0.156.0>]
>>>    dictionary:
>>> [{random_seed,{10759,27224,17036}},{worker_pool_worker,true}]
>>>    trap_exit: false
>>>    status: running
>>>    heap_size: 233
>>>    stack_size: 24
>>>    reductions: 310874
>>>  neighbours:
>>>
>>> I've attached the full logs the server has produced in the hope they
>>> shed more light on the situation.
>>
>> Interesting. I gather this is reproducible, right? In which case  
>> could you
>> please package up the various bits that make up the rabbit  
>> installation on
>> those two machines - rabbit installation dir, plugins dir, mnesia  
>> dir,
>> config files - and put them somewhere we can grab them?
>>
>>
>> Regards,
>>
>> Matthias.
>> _______________________________________________
>> rabbitmq-discuss mailing list
>> rabbitmq-discuss at lists.rabbitmq.com
>> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>>
>
>
>
> -- 
> Aaron Westendorf
> Senior Software Engineer
> Agora Games
> 359 Broadway
> Troy, NY 12180
> Phone: 518.268.1000
> aaron at agoragames.com
> www.agoragames.com