<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>Hi folks, we had a problem today where the MQ server kept crashing and we think it was due to some client pushing in a bad message as we were able to keep the server up only after removing access to some users. We’re still trying to track down the exact client that was causing the issues. However the cause of the crash was listed in the logs as bellow. I couldn’t find any references to “badmatch” errors on the list before so I was wondering if anyone has seen it?<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>We’re running Rabbitmq 2.8.5 on erlang 1:15.b.1-1~ubuntu~lucid. Thanks!<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>=ERROR REPORT==== 20-Sep-2012::12:59:37 ===<o:p></o:p></p><p class=MsoNormal>** Generic server <0.229.0> terminating<o:p></o:p></p><p class=MsoNormal>** Last message in was {'$gen_cast',{combine,1001,999}}<o:p></o:p></p><p class=MsoNormal>** When Server state == {state,<o:p></o:p></p><p class=MsoNormal> {dict,0,16,16,8,80,48,<o:p></o:p></p><p class=MsoNormal> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],<o:p></o:p></p><p class=MsoNormal> []},<o:p></o:p></p><p class=MsoNormal> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],<o:p></o:p></p><p class=MsoNormal> [],[]}}},<o:p></o:p></p><p class=MsoNormal> [#Fun<rabbit_msg_store.15.106110853>],<o:p></o:p></p><p class=MsoNormal> {gc_state,<o:p></o:p></p><p class=MsoNormal> "/mnt/drbd0/rabbit@localhost/msg_store_persistent",<o:p></o:p></p><p class=MsoNormal> rabbit_msg_store_ets_index,<o:p></o:p></p><p class=MsoNormal> {state,458823,<o:p></o:p></p><p class=MsoNormal> "/mnt/drbd0/rabbit@localhost/msg_store_persistent"},<o:p></o:p></p><p class=MsoNormal> 454726,462920,<0.226.0>}}<o:p></o:p></p><p class=MsoNormal>** Reason for termination == <o:p></o:p></p><p class=MsoNormal>** {{badmatch,{[{msg_location,<<119,180,79,244,242,22,59,63,219,227,203,29,171,<o:p></o:p></p><p class=MsoNormal> 138,191,149>>,<o:p></o:p></p><p class=MsoNormal> 1,999,2301,298},<o:p></o:p></p><p class=MsoNormal> {msg_location,<<15,166,249,210,74,141,92,125,164,106,201,179,<o:p></o:p></p><p class=MsoNormal> 247,29,128,81>>,<o:p></o:p></p><p class=MsoNormal> 1,999,4643,297},<o:p></o:p></p><p class=MsoNormal> {msg_location,<<61,32,10,20,15,47,161,44,66,91,98,119,129,10,<o:p></o:p></p><p class=MsoNormal> 230,135>>,<o:p></o:p></p><p class=MsoNormal> 1,999,7239,297},<o:p></o:p></p><p class=MsoNormal> {msg_location,<<242,222,190,244,108,107,42,177,98,113,130,255,<o:p></o:p></p><p class=MsoNormal> 211,78,44,242>>,<o:p></o:p></p><p class=MsoNormal> 1,999,7791,297},<o:p></o:p></p><p class=MsoNormal> {msg_location,<<107,45,44,203,166,43,87,116,132,109,19,63,113,<o:p></o:p></p><p class=MsoNormal> 184,191,143>>,<o:p></o:p></p><p class=MsoNormal> 1,999,9877,297},<o:p></o:p></p><p class=MsoNormal>..... { THOUSANDS OF LINES } .....<o:p></o:p></p><p class=MsoNormal> {msg_location,<<167,233,20,236,134,250,109,211,72,107,129,39,<o:p></o:p></p><p class=MsoNormal> 57,87,109,67>>,<o:p></o:p></p><p class=MsoNormal> 1,999,1580282,254}],<o:p></o:p></p><p class=MsoNormal> 378139}},<o:p></o:p></p><p class=MsoNormal> [{rabbit_msg_store,combine_files,3,[]},<o:p></o:p></p><p class=MsoNormal> {rabbit_msg_store_gc,attempt_action,3,[]},<o:p></o:p></p><p class=MsoNormal> {rabbit_msg_store_gc,handle_cast,2,[]},<o:p></o:p></p><p class=MsoNormal> {gen_server2,handle_msg,2,[]},<o:p></o:p></p><p class=MsoNormal> {proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,237}]}]}<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>=ERROR REPORT==== 20-Sep-2012::13:31:15 ===<o:p></o:p></p><p class=MsoNormal>Error description:<o:p></o:p></p><p class=MsoNormal> {shutdown,<o:p></o:p></p><p class=MsoNormal> {gen_server,call,<o:p></o:p></p><p class=MsoNormal> [{rabbit_amqqueue_sup,rabbit@localhost},<o:p></o:p></p><p class=MsoNormal> {start_child,<o:p></o:p></p><p class=MsoNormal> [{amqqueue,<o:p></o:p></p><p class=MsoNormal> {resource,<<"/exchange/queu">>,queue,<o:p></o:p></p><p class=MsoNormal> <<"/queue/hostname:1983">>},<o:p></o:p></p><p class=MsoNormal> true,false,none,[],<0.2434.0>,[],undefined}]},<o:p></o:p></p><p class=MsoNormal> infinity]}}<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Log files (may contain more information):<o:p></o:p></p><p class=MsoNormal> /var/log/rabbitmq/rabbit@localhost.log<o:p></o:p></p><p class=MsoNormal> /var/log/rabbitmq/rabbit@localhost-sasl.log<o:p></o:p></p></div></body></html>