<div dir="ltr"><div><div>We're seeing a bunch of failure messages from our Ruby clients to RabbitMQ 3.0.2. From the client side, we see 541 "Internal Error"<br><br>On the server side logs, we see a bunch of errors. Normally I can at least hazard a guess what's wrong, but I have no idea with this:<br>
<br><br>=ERROR REPORT==== 16-Jul-2013::22:43:15 ===<br>** Generic server <0.4358.0> terminating<br>** Last message in was {can_send,<0.4355.0>,true}<br>** When Server state == {lim,1,<0.4359.0>,false,[],1}<br>
** Reason for termination == <br>** {function_clause,[{orddict,update,<br> [<0.4355.0>,#Fun<rabbit_limiter.3.113433752>,[]],<br> [{file,"orddict.erl"},{line,153}]},<br>
{rabbit_limiter,limit_queue,2,[]},<br> {rabbit_limiter,handle_call,3,[]},<br> {gen_server2,handle_msg,2,[]},<br> {proc_lib,init_p_do_apply,3,<br>
[{file,"proc_lib.erl"},{line,227}]}]}<br><br><br><br></div><div>Or like this:<br>--------------------<br><br><br>=ERROR REPORT==== 16-Jul-2013::22:44:15 ===<br>** Generic server <0.4563.0> terminating<br>
** Last message in was {'$gen_cast',<br> {method,<br> {'basic.consume',0,<<"web-tasks-mpietrek">>,<br> <<"web-tasks-mpietrek-1374014655000-264079359112">>,<br>
false,false,false,false,[]},<br> none,noflow}}<br>** When Server state == {ch,running,rabbit_framing_amqp_0_9_1,41,<0.4540.0>,<br> <0.4560.0>,<0.4540.0>,<br>
<<"<a href="http://192.168.78.13:57671">192.168.78.13:57671</a> -> <a href="http://192.168.78.50:5672">192.168.78.50:5672</a>">>,<br> {lstate,<0.4561.0>,true,false},<br>
none,2,<br> {[],[]},<br> {user,<<"guest">>,<br> [administrator],<br> rabbit_auth_backend_internal,<br>
{internal_user,<<"guest">>,<br> <<78,56,17,4,226,151,136,14,156,84,34,25,101,29,104,<br> 78,125,130,202,207>>,<br>
[administrator]}},<br> <<"/">>,<<"web-tasks-mpietrek">>,<br> {dict,1,16,16,8,80,48,<br> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},<br>
{{[],[],[],[],[],[],[],<br> [[<0.4558.0>|<br> {resource,<<"/">>,queue,<br> <<"web-tasks-mpietrek">>}]],<br>
[],[],[],[],[],[],[],[]}}},<br> {dict,3,16,16,8,80,48,<br> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},<br> {{[],[],[],[],[],[],[],<br>
[[<0.4558.0>|#Ref<0.0.0.83887>]],<br> [],[],[],[],<br> [[<2783.2507.0>|#Ref<0.0.0.83888>]],<br> [[<2782.2563.0>|#Ref<0.0.0.83889>]],<br>
[],[]}}},<br> {dict,0,16,16,8,80,48,<br> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},<br> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<br>
{set,0,16,16,8,80,48,<br> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},<br> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<br> {dict,0,16,16,8,80,48,<br>
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},<br> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<br> {set,1,16,16,8,80,48,<br> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},<br>
{{[],[],[],[],[],[],[],<br> [<0.4558.0>],<br> [],[],[],[],[],[],[],[]}}},<br> <0.4539.0>,<br> {state,fine,5000,#Ref<0.0.0.86733>},<br>
false,1,<br> {{0,nil},{0,nil}},<br> [],<br> [{<<"consumer_cancel_notify">>,bool,true}],<br> none}<br>
<br></div>Or like this:<br>--------------------<br><br>=ERROR REPORT==== 16-Jul-2013::22:44:15 ===<br>** Generic server <0.4561.0> terminating<br>** Last message in was {can_send,<0.4558.0>,true}<br>** When Server state == {lim,1,<0.4563.0>,false,[],1}<br>
** Reason for termination == <br>** {function_clause,[{orddict,update,<br> [<0.4558.0>,#Fun<rabbit_limiter.3.113433752>,[]],<br> [{file,"orddict.erl"},{line,153}]},<br>
{rabbit_limiter,limit_queue,2,[]},<br> {rabbit_limiter,handle_call,3,[]},<br> {gen_server2,handle_msg,2,[]},<br> {proc_lib,init_p_do_apply,3,<br>
[{file,"proc_lib.erl"},{line,227}]}]}<br><br>=ERROR REPORT==== 16-Jul-2013::22:44:15 ===<br>** Generic server <0.4558.0> terminating<br>** Last message in was {basic_consume,false,<0.4563.0>,<0.4561.0>,true,<br>
<<"web-tasks-mpietrek-1374014655000-264079359112">>,<br> false,none,<br> {'basic.consume_ok',<br> <<"web-tasks-mpietrek-1374014655000-264079359112">>}}<br>
** When Server state == {q,<br> {amqqueue,<br> {resource,<<"/">>,queue,<<"web-tasks-mpietrek">>},<br> true,false,none,[],<0.4558.0>,[],[],<br>
[{vhost,<<"/">>},<br> {name,<<"ha-web-tasks-mpietrek">>},<br> {pattern,<<"web-tasks-mpietrek">>},<br>
{definition,[{<<"ha-mode">>,<<"all">>}]},<br> {priority,0}],<br> []},<br> none,true,rabbit_mirror_queue_master,<br>
{state,<br> {resource,<<"/">>,queue,<<"web-tasks-mpietrek">>},<br> <0.4566.0>,<0.4565.0>,rabbit_variable_queue,<br>
{vqstate,<br> {0,{[],[]}},<br> {0,{[],[]}},<br> {delta,undefined,0,undefined},<br> {0,{[],[]}},<br>
{13,<br> {[{msg_status,12,<br> <<114,86,130,79,196,29,163,190,216,213,230,38,<br> 174,139,39,60>>,<br>
{basic_message,<br> {resource,<<"/">>,exchange,<<"skytap">>},<br> [<<"web-tasks-mpietrek.mpietrek.default">>],<br>
{content,60,<br> {'P_basic',<<"application/octet-stream">>,<br> undefined,undefined,2,0,undefined,undefined,<br>
undefined,undefined,undefined,undefined,<br> undefined,undefined,undefined},<br> <<152,0,24,97,112,112,108,105,99,97,116,105,<br>
111,110,47,111,99,116,101,116,45,115,116,<br> 114,101,97,109,2,0>>,<br> rabbit_framing_amqp_0_9_1,<br> [<<"{\"payload\":{\"object\":\"BAhvOh1EZWxldGVFeHBpcmVkVXBsb2Fkc1Rhc2sGOhJAZ3JhY2VfcGVyaW9k\\nbzocQWN0aXZlU3VwcG9ydDo6RHVyYXRpb24HOgtAdmFsdWVpAwB1EjoLQHBh\\ncnRzWwZbBzoJZGF5c2kT\\n\"},\"_serialization_type\":\"marshal\",\"_timestamp\":\"2013-07-16T22:43:55Z\",\"_message_type\":\"request\",\"_unique_id\":\"app1:req:wfe-em-init.80690eb0d0940130f02f000c291bd1d8.2.372:336\",\"caller_context\":\"wfe-em-init.80690eb0d0940130f02f000c291bd1d8.2.373\",\"action\":\"async-task\",\"_mq_protocol_version\":1}">>]},<br>
<<114,86,130,79,196,29,163,190,216,213,230,38,<br> 174,139,39,60>>,<br> true},<br> true,false,true,true,<br>
{message_properties,undefined,false}},<br> {msg_status,11,<br> <<12,29,215,111,220,221,165,115,106,150,132,130,<br> 118,94,193,26>>,<br>
{basic_message,<br> {resource,<<"/">>,exchange,<<"skytap">>},<br> [<<"web-tasks-mpietrek.mpietrek.default">>],<br>
{content,60,<br> {'P_basic',<<"application/octet-stream">>,<br> undefined,undefined,2,0,undefined,undefined,<br>
undefined,undefined,undefined,undefined,<br> undefined,undefined,undefined},<br> <<152,0,24,97,112,112,108,105,99,97,116,105,<br>
111,110,47,111,99,116,101,116,45,115,116,<br> 114,101,97,109,2,0>>,<br> rabbit_framing_amqp_0_9_1,<br><br></div><rest of error omitted><br>
</div>