<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 12 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>Hello,<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I just noticed a crash report in sasl log of one of our RMQ server.<o:p></o:p></p><p class=MsoNormal>It seems the management plug-in crashed. The management web page cannot be opened any more.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I had this problem before with an old version. Now I am using 2.8.6 64-bit version on Windows 2008 Server.<o:p></o:p></p><p class=MsoNormal>The RMQ server is still running fine, but the memory utilization is much higher than other similar servers without such crash.<o:p></o:p></p><p class=MsoNormal>This “bad” server uses about 8 GB memory now, while other normal servers use only about 500 MB memory.<o:p></o:p></p><p class=MsoNormal>It may eventually hit the high memory water mark soon at 9.6 GB.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Here is the complete crash report.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>=CRASH REPORT==== 29-Oct-2012::23:01:08 ===<o:p></o:p></p><p class=MsoNormal> crasher:<o:p></o:p></p><p class=MsoNormal> initial call: rabbit_mgmt_db:init/1<o:p></o:p></p><p class=MsoNormal> pid: <0.284.0><o:p></o:p></p><p class=MsoNormal> registered_name: []<o:p></o:p></p><p class=MsoNormal> exception exit: {badarith,<o:p></o:p></p><p class=MsoNormal> [{rabbit_mgmt_db,rate,5,[]},<o:p></o:p></p><p class=MsoNormal> {rabbit_mgmt_db,'-rates/5-lc$^0/1-0-',5,[]},<o:p></o:p></p><p class=MsoNormal> {rabbit_mgmt_db,'-rates/5-lc$^1/1-1-',6,[]},<o:p></o:p></p><p class=MsoNormal> {rabbit_mgmt_db,rates,5,[]},<o:p></o:p></p><p class=MsoNormal> {rabbit_mgmt_db,handle_fine_stat,7,[]},<o:p></o:p></p><p class=MsoNormal> {rabbit_mgmt_db,'-handle_fine_stats/4-lc$^1/1-1-',4,<o:p></o:p></p><p class=MsoNormal> []},<o:p></o:p></p><p class=MsoNormal> {rabbit_mgmt_db,'-handle_event/2-lc$^1/1-0-',4,[]},<o:p></o:p></p><p class=MsoNormal> {rabbit_mgmt_db,handle_event,2,[]}]}<o:p></o:p></p><p class=MsoNormal> in function gen_server:terminate/6 (gen_server.erl, line 747)<o:p></o:p></p><p class=MsoNormal> ancestors: [<0.281.0>,rabbit_mgmt_sup,<0.262.0>]<o:p></o:p></p><p class=MsoNormal> messages: [{'$gen_cast',<o:p></o:p></p><p class=MsoNormal> {event,<o:p></o:p></p><p class=MsoNormal> {event,channel_stats,<o:p></o:p></p><p class=MsoNormal> [{pid,<0.12756.396>},<o:p></o:p></p><p class=MsoNormal> {transactional,false},<o:p></o:p></p><p class=MsoNormal> {confirm,false},<o:p></o:p></p><p class=MsoNormal> {consumer_count,0},<o:p></o:p></p><p class=MsoNormal> {messages_unacknowledged,0},<o:p></o:p></p><p class=MsoNormal> {messages_unconfirmed,0},<o:p></o:p></p><p class=MsoNormal> {messages_uncommitted,0},<o:p></o:p></p><p class=MsoNormal> {acks_uncommitted,0},<o:p></o:p></p><p class=MsoNormal> {prefetch_count,1},<o:p></o:p></p><p class=MsoNormal> {client_flow_blocked,false},<o:p></o:p></p><p class=MsoNormal> {channel_queue_stats,[]},<o:p></o:p></p><p class=MsoNormal> {channel_exchange_stats,[]},<o:p></o:p></p><p class=MsoNormal> {channel_queue_exchange_stats,[]}],<o:p></o:p></p><p class=MsoNormal> {1351,576868,812003}}}}]<o:p></o:p></p><p class=MsoNormal> links: [<0.281.0>]<o:p></o:p></p><p class=MsoNormal> dictionary: []<o:p></o:p></p><p class=MsoNormal> trap_exit: false<o:p></o:p></p><p class=MsoNormal> status: running<o:p></o:p></p><p class=MsoNormal> heap_size: 6765<o:p></o:p></p><p class=MsoNormal> stack_size: 24<o:p></o:p></p><p class=MsoNormal> reductions: 3730467164<o:p></o:p></p><p class=MsoNormal> neighbours:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Here is the output of “rabbitmqctl.bat status”<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'>Status of node rabbit@RACK4UNIT001 ...<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'>[{pid,4708},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {running_applications,<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> [{rabbitmq_management,"RabbitMQ Management Console","2.8.6"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {rabbitmq_management_agent,"RabbitMQ Management Agent","2.8.6"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {amqp_client,"RabbitMQ AMQP Client","2.8.6"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {rabbit,"RabbitMQ","2.8.6"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {os_mon,"CPO CXC 138 46","2.2.10"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {sasl,"SASL CXC 138 11","2.2.1"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {rabbitmq_mochiweb,"RabbitMQ Mochiweb Embedding","2.8.6"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {webmachine,"webmachine","1.9.1-rmq2.8.6-git52e62bc"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {mochiweb,"MochiMedia Web Server","2.3.1-rmq2.8.6-gitd541e9a"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {xmerl,"XML parser","1.3.2"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {inets,"INETS CXC 138 49","5.9.1"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {mnesia,"MNESIA CXC 138 12","4.7.1"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {stdlib,"ERTS CXC 138 10","1.18.2"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {kernel,"ERTS CXC 138 10","2.15.2"}]},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {os,{win32,nt}},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {erlang_version,<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> "Erlang R15B02 (erts-5.9.2) [64-bit] [smp:12:12] [async-threads:30]\n"},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {memory,<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> [{total,8512001360},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {processes,7401925315},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {processes_used,7401754972},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {system,1110076045},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {atom,662409},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {atom_used,652416},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {binary,857726336},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {code,17969722},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {ets,4550280}]},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {vm_memory_high_watermark,0.4},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {vm_memory_limit,10304190873},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {disk_free_limit,1000000000},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {disk_free,39365828608},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {file_descriptors,<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> [{total_limit,16284},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {total_used,142},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {sockets_limit,14653},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {sockets_used,113}]},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {processes,[{limit,1048576},{used,5986}]},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {run_queue,0},<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'> {uptime,104350}]<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'>...done.<o:p></o:p></span></p><p class=MsoNormal style='text-autospace:none'><span style='font-family:"Courier New"'><o:p> </o:p></span></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Best regards,<o:p></o:p></p><p class=MsoNormal>--Bin Chen<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>