<div dir="ltr">Hello,<div>We are running Rabbit 2.8.6 on Erlang R14B04. We got this error on one of 3 rabbit servers in our cluster. After that we observed the followings:</div><div>1. all 3 rabbit servers went on high cpu usage </div>
<div style>2. management interface was not functional</div><div style>3. workers were not able to consume from queues</div><div style><br></div><div style>Trying to stop the rabbit server failed (/etc/init.d/rabbitmq-server stop) and end up hard kill (kill -9) rabbit process on all nodes of the cluster to get the system back. All mirrored queues contents were lost. </div>
<div style><br></div><div style>Can someone points us to what may have caused this? Any help is greatly appreciated.</div><div style><br></div><div style>Thanks,</div><div><span style="font-family:arial,sans-serif;font-size:13px"><br>
</span></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:13px">ERROR REPORT==== 9-Apr-2013::10:56:49 ===</span><div style="font-family:arial,sans-serif;font-size:13px">
** Generic server <0.9085.0> terminating</div><div style="font-family:arial,sans-serif;font-size:13px">** Last message in was {'$gen_cast',</div><div style="font-family:arial,sans-serif;font-size:13px"> {delete_and_terminate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {function_clause,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{rabbit_amqqueue_process,handle_call,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [{add_on_right,{74,<0.7181.510>}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<0.7181.510>,#Ref<0.0.14625.121725>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {q,</div><div style="font-family:arial,sans-serif;font-size:13px"> {amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px">
{resource,<<"/fonsyncd/prod/">>,queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div><div style="font-family:arial,sans-serif;font-size:13px">
{state,<0.4404.0>,<0.9085.0>,</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px">
{vqstate,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {delta,undefined,0,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> 2114,</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {qistate,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px">
#Ref<0.0.25.88612>,0,262144,</div><div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px">
<<72,22,217,216,236,0,110,187,235,185,163,</div><div style="font-family:arial,sans-serif;font-size:13px"> 249,92,182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div><div style="font-family:arial,sans-serif;font-size:13px">
<<51,15,67,134,52,182,142,196,131,185,177,5,</div><div style="font-family:arial,sans-serif;font-size:13px"> 223,15,45,61>>,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.264.0>,680005,671795,684102,688199}},</div><div style="font-family:arial,sans-serif;font-size:13px"> true,0,</div><div style="font-family:arial,sans-serif;font-size:13px">
#Fun<rabbit_mirror_queue_slave.1.52898136>,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,infinity,0,0,0,0,0,</div><div style="font-family:arial,sans-serif;font-size:13px">
{rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px">
{1365,529286,74299}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
0,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17781.499>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px">
{state,fine,5000,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
100000,undefined,1365529282744274,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<0.17781.499>|#Ref<0.0.14563.86169>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7526.16733.575>|#Ref<0.0.14563.86260>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 1,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {gen_server2,handle_msg,2},</div><div style="font-family:arial,sans-serif;font-size:13px"> {proc_lib,wake_up,3}]}}}</div>
<div style="font-family:arial,sans-serif;font-size:13px">** When Server state == {state,</div><div style="font-family:arial,sans-serif;font-size:13px"> {amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px">
{resource,<<"/fonsyncd/prod/">>,queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.4404.0>,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86480>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17781.499>|#Ref<0.0.14563.86174>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.9758.575>|#Ref<0.0.14563.86397>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7526.16733.575>|#Ref<0.0.14563.86263>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86686>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.14563.86622>]]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_mirror_queue_master.1.37767645>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_mirror_queue_master.2.24464450>}</div><div style="font-family:arial,sans-serif;font-size:13px">** Reason for termination == </div>
<div style="font-family:arial,sans-serif;font-size:13px">** {function_clause,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{rabbit_amqqueue_process,handle_call,</div><div style="font-family:arial,sans-serif;font-size:13px">
[{add_on_right,{74,<0.7181.510>}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<0.7181.510>,#Ref<0.0.14625.121725>},</div><div style="font-family:arial,sans-serif;font-size:13px">
{q,{amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,queue,</div><div style="font-family:arial,sans-serif;font-size:13px">
<<"Q-SID.16970.fonsyncd">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div><div style="font-family:arial,sans-serif;font-size:13px">
[{<<"x-message-ttl">>,signedint,100000},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,<0.4404.0>,<0.9085.0>,rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {vqstate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{delta,undefined,0,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 2114,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {qistate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div><div style="font-family:arial,sans-serif;font-size:13px">
{{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.25.88612>,0,262144,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<72,22,217,216,236,0,110,187,235,185,163,249,92,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<51,15,67,134,52,182,142,196,131,185,177,5,223,</div><div style="font-family:arial,sans-serif;font-size:13px"> 15,45,61>>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.264.0>,680005,671795,684102,688199}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,0,#Fun<rabbit_mirror_queue_slave.1.52898136>,0,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> infinity,0,0,0,0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17781.499>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,fine,5000,undefined},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 100000,undefined,1365529282744274,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<0.17781.499>|#Ref<0.0.14563.86169>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7526.16733.575>|#Ref<0.0.14563.86260>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 1,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {gen_server2,handle_msg,2},</div><div style="font-family:arial,sans-serif;font-size:13px"> {proc_lib,wake_up,3}]}</div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">=ERROR REPORT==== 9-Apr-2013::10:56:49 ===</div><div style="font-family:arial,sans-serif;font-size:13px">
** Generic server <0.4403.0> terminating</div><div style="font-family:arial,sans-serif;font-size:13px">** Last message in was {add_on_right,{74,<0.7181.510>}}</div><div style="font-family:arial,sans-serif;font-size:13px">
** When Server state == {q,</div><div style="font-family:arial,sans-serif;font-size:13px"> {amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,queue,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,<0.4404.0>,<0.9085.0>,rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {vqstate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{delta,undefined,0,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> 2114,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{qistate,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div><div style="font-family:arial,sans-serif;font-size:13px">
{{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.25.88612>,0,262144,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<72,22,217,216,236,0,110,187,235,185,163,249,92,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> []}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<51,15,67,134,52,182,142,196,131,185,177,5,223,</div><div style="font-family:arial,sans-serif;font-size:13px"> 15,45,61>>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.264.0>,680005,671795,684102,688199}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,0,#Fun<rabbit_mirror_queue_slave.1.52898136>,</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,infinity,0,0,0,0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17781.499>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,fine,5000,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 100000,undefined,1365529282744274,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,6,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17781.499>|#Ref<0.0.14563.86169>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7526.16733.575>|#Ref<0.0.14563.86260>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> 1,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}</div>
<div style="font-family:arial,sans-serif;font-size:13px">** Reason for termination == </div><div style="font-family:arial,sans-serif;font-size:13px">** {function_clause,</div><div style="font-family:arial,sans-serif;font-size:13px">
[{rabbit_amqqueue_process,handle_call,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{add_on_right,{74,<0.7181.510>}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{<0.7181.510>,#Ref<0.0.14625.121725>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {q,{amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,queue,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,<0.4404.0>,<0.9085.0>,rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {vqstate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{delta,undefined,0,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 2114,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {qistate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div><div style="font-family:arial,sans-serif;font-size:13px">
{{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.25.88612>,0,262144,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<72,22,217,216,236,0,110,187,235,185,163,249,92,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<51,15,67,134,52,182,142,196,131,185,177,5,223,</div><div style="font-family:arial,sans-serif;font-size:13px"> 15,45,61>>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.264.0>,680005,671795,684102,688199}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,0,#Fun<rabbit_mirror_queue_slave.1.52898136>,0,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> infinity,0,0,0,0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17781.499>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,fine,5000,undefined},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 100000,undefined,1365529282744274,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<0.17781.499>|#Ref<0.0.14563.86169>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7526.16733.575>|#Ref<0.0.14563.86260>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 1,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {gen_server2,handle_msg,2},</div><div style="font-family:arial,sans-serif;font-size:13px"> {proc_lib,wake_up,3}]}</div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">=ERROR REPORT==== 9-Apr-2013::10:56:49 ===</div><div style="font-family:arial,sans-serif;font-size:13px">** Generic server <0.7181.510> terminating</div>
<div style="font-family:arial,sans-serif;font-size:13px">** Last message in was {'$gen_cast',join}</div><div style="font-family:arial,sans-serif;font-size:13px">** When Server state == {state,</div><div style="font-family:arial,sans-serif;font-size:13px">
{74,<0.7181.510>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{74,<0.7181.510>},undefined},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{74,<0.7181.510>},undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,queue,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.18335.fonsyncd">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_mirror_queue_slave,undefined,-1,undefined,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<0.7180.510>],</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
[],undefined}</div><div style="font-family:arial,sans-serif;font-size:13px">** Reason for termination == </div><div style="font-family:arial,sans-serif;font-size:13px">** {{function_clause,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [{rabbit_amqqueue_process,handle_call,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{add_on_right,{74,<0.7181.510>}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<0.7181.510>,#Ref<0.0.14625.121725>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {q,{amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px">
{resource,<<"/fonsyncd/prod/">>,queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div><div style="font-family:arial,sans-serif;font-size:13px">
{state,<0.4404.0>,<0.9085.0>,rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {vqstate,</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {delta,undefined,0,undefined},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
2114,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {qistate,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div><div style="font-family:arial,sans-serif;font-size:13px"> {{dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.25.88612>,0,262144,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<72,22,217,216,236,0,110,187,235,185,163,249,92,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<51,15,67,134,52,182,142,196,131,185,177,5,223,</div><div style="font-family:arial,sans-serif;font-size:13px"> 15,45,61>>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.264.0>,680005,671795,684102,688199}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,0,#Fun<rabbit_mirror_queue_slave.1.52898136>,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,infinity,0,0,0,0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[<0.17781.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px">
{state,fine,5000,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 100000,undefined,1365529282744274,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17781.499>|#Ref<0.0.14563.86169>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7526.16733.575>|#Ref<0.0.14563.86260>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 1,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {gen_server2,handle_msg,2},</div><div style="font-family:arial,sans-serif;font-size:13px"> {proc_lib,wake_up,3}]},</div><div style="font-family:arial,sans-serif;font-size:13px">
{gen_server2,call,[<0.4403.0>,{add_on_right,{74,<0.7181.510>}},infinity]}}</div><div><br></div><div><br></div><div><br></div><div><div style="font-family:arial,sans-serif;font-size:13px">ERROR REPORT==== 9-Apr-2013::10:56:49 ===</div>
<div style="font-family:arial,sans-serif;font-size:13px">** Generic server <0.9085.0> terminating</div><div style="font-family:arial,sans-serif;font-size:13px">** Last message in was {'$gen_cast',</div><div style="font-family:arial,sans-serif;font-size:13px">
{delete_and_terminate,</div><div style="font-family:arial,sans-serif;font-size:13px"> {function_clause,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{rabbit_amqqueue_process,handle_call,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [{add_on_right,{74,<0.7181.510>}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<0.7181.510>,#Ref<0.0.14625.121725>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {q,</div><div style="font-family:arial,sans-serif;font-size:13px"> {amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px">
{resource,<<"/fonsyncd/prod/">>,queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div><div style="font-family:arial,sans-serif;font-size:13px">
{state,<0.4404.0>,<0.9085.0>,</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px">
{vqstate,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {delta,undefined,0,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> 2114,</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {qistate,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px">
#Ref<0.0.25.88612>,0,262144,</div><div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px">
<<72,22,217,216,236,0,110,187,235,185,163,</div><div style="font-family:arial,sans-serif;font-size:13px"> 249,92,182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div><div style="font-family:arial,sans-serif;font-size:13px">
<<51,15,67,134,52,182,142,196,131,185,177,5,</div><div style="font-family:arial,sans-serif;font-size:13px"> 223,15,45,61>>,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.264.0>,680005,671795,684102,688199}},</div><div style="font-family:arial,sans-serif;font-size:13px"> true,0,</div><div style="font-family:arial,sans-serif;font-size:13px">
#Fun<rabbit_mirror_queue_slave.1.52898136>,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,infinity,0,0,0,0,0,</div><div style="font-family:arial,sans-serif;font-size:13px">
{rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px">
{1365,529286,74299}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
0,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17781.499>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px">
{state,fine,5000,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
100000,undefined,1365529282744274,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<0.17781.499>|#Ref<0.0.14563.86169>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7526.16733.575>|#Ref<0.0.14563.86260>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 1,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {gen_server2,handle_msg,2},</div><div style="font-family:arial,sans-serif;font-size:13px"> {proc_lib,wake_up,3}]}}}</div>
<div style="font-family:arial,sans-serif;font-size:13px">** When Server state == {state,</div><div style="font-family:arial,sans-serif;font-size:13px"> {amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px">
{resource,<<"/fonsyncd/prod/">>,queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.4404.0>,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86480>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17781.499>|#Ref<0.0.14563.86174>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.9758.575>|#Ref<0.0.14563.86397>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7526.16733.575>|#Ref<0.0.14563.86263>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86686>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.14563.86622>]]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_mirror_queue_master.1.37767645>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_mirror_queue_master.2.24464450>}</div><div style="font-family:arial,sans-serif;font-size:13px">** Reason for termination == </div>
<div style="font-family:arial,sans-serif;font-size:13px">** {function_clause,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{rabbit_amqqueue_process,handle_call,</div><div style="font-family:arial,sans-serif;font-size:13px">
[{add_on_right,{74,<0.7181.510>}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<0.7181.510>,#Ref<0.0.14625.121725>},</div><div style="font-family:arial,sans-serif;font-size:13px">
{q,{amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,queue,</div><div style="font-family:arial,sans-serif;font-size:13px">
<<"Q-SID.16970.fonsyncd">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div><div style="font-family:arial,sans-serif;font-size:13px">
[{<<"x-message-ttl">>,signedint,100000},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,<0.4404.0>,<0.9085.0>,rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {vqstate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{delta,undefined,0,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 2114,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {qistate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div><div style="font-family:arial,sans-serif;font-size:13px">
{{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.25.88612>,0,262144,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<72,22,217,216,236,0,110,187,235,185,163,249,92,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<51,15,67,134,52,182,142,196,131,185,177,5,223,</div><div style="font-family:arial,sans-serif;font-size:13px"> 15,45,61>>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.264.0>,680005,671795,684102,688199}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,0,#Fun<rabbit_mirror_queue_slave.1.52898136>,0,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> infinity,0,0,0,0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17781.499>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,fine,5000,undefined},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 100000,undefined,1365529282744274,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<0.17781.499>|#Ref<0.0.14563.86169>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7526.16733.575>|#Ref<0.0.14563.86260>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 1,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {gen_server2,handle_msg,2},</div><div style="font-family:arial,sans-serif;font-size:13px"> {proc_lib,wake_up,3}]}</div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">=ERROR REPORT==== 9-Apr-2013::10:56:49 ===</div><div style="font-family:arial,sans-serif;font-size:13px">
** Generic server <0.4403.0> terminating</div><div style="font-family:arial,sans-serif;font-size:13px">** Last message in was {add_on_right,{74,<0.7181.510>}}</div><div style="font-family:arial,sans-serif;font-size:13px">
** When Server state == {q,</div><div style="font-family:arial,sans-serif;font-size:13px"> {amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,queue,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,<0.4404.0>,<0.9085.0>,rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {vqstate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{delta,undefined,0,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> 2114,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{qistate,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div><div style="font-family:arial,sans-serif;font-size:13px">
{{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.25.88612>,0,262144,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<72,22,217,216,236,0,110,187,235,185,163,249,92,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> []}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<51,15,67,134,52,182,142,196,131,185,177,5,223,</div><div style="font-family:arial,sans-serif;font-size:13px"> 15,45,61>>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.264.0>,680005,671795,684102,688199}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,0,#Fun<rabbit_mirror_queue_slave.1.52898136>,</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,infinity,0,0,0,0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17781.499>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,fine,5000,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 100000,undefined,1365529282744274,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,6,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17781.499>|#Ref<0.0.14563.86169>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7526.16733.575>|#Ref<0.0.14563.86260>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> 1,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}</div>
<div style="font-family:arial,sans-serif;font-size:13px">** Reason for termination == </div><div style="font-family:arial,sans-serif;font-size:13px">** {function_clause,</div><div style="font-family:arial,sans-serif;font-size:13px">
[{rabbit_amqqueue_process,handle_call,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{add_on_right,{74,<0.7181.510>}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{<0.7181.510>,#Ref<0.0.14625.121725>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {q,{amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,queue,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,<0.4404.0>,<0.9085.0>,rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {vqstate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{delta,undefined,0,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 2114,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {qistate,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div><div style="font-family:arial,sans-serif;font-size:13px">
{{dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.25.88612>,0,262144,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<72,22,217,216,236,0,110,187,235,185,163,249,92,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<51,15,67,134,52,182,142,196,131,185,177,5,223,</div><div style="font-family:arial,sans-serif;font-size:13px"> 15,45,61>>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.264.0>,680005,671795,684102,688199}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,0,#Fun<rabbit_mirror_queue_slave.1.52898136>,0,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> infinity,0,0,0,0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17781.499>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,fine,5000,undefined},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 100000,undefined,1365529282744274,</div><div style="font-family:arial,sans-serif;font-size:13px">
{dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<0.17781.499>|#Ref<0.0.14563.86169>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px">
[[<7526.16733.575>|#Ref<0.0.14563.86260>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 1,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {gen_server2,handle_msg,2},</div><div style="font-family:arial,sans-serif;font-size:13px"> {proc_lib,wake_up,3}]}</div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">=ERROR REPORT==== 9-Apr-2013::10:56:49 ===</div><div style="font-family:arial,sans-serif;font-size:13px">** Generic server <0.7181.510> terminating</div>
<div style="font-family:arial,sans-serif;font-size:13px">** Last message in was {'$gen_cast',join}</div><div style="font-family:arial,sans-serif;font-size:13px">** When Server state == {state,</div><div style="font-family:arial,sans-serif;font-size:13px">
{74,<0.7181.510>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{74,<0.7181.510>},undefined},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{74,<0.7181.510>},undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,queue,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.18335.fonsyncd">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_mirror_queue_slave,undefined,-1,undefined,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [<0.7180.510>],</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px">
[],undefined}</div><div style="font-family:arial,sans-serif;font-size:13px">** Reason for termination == </div><div style="font-family:arial,sans-serif;font-size:13px">** {{function_clause,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [{rabbit_amqqueue_process,handle_call,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{add_on_right,{74,<0.7181.510>}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<0.7181.510>,#Ref<0.0.14625.121725>},</div><div style="font-family:arial,sans-serif;font-size:13px"> {q,{amqqueue,</div><div style="font-family:arial,sans-serif;font-size:13px">
{resource,<<"/fonsyncd/prod/">>,queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"Q-SID.16970.fonsyncd">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,false,none,</div><div style="font-family:arial,sans-serif;font-size:13px"> [{<<"x-message-ttl">>,signedint,100000},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-dead-letter-exchange">>,longstr,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {<<"x-ha-policy">>,longstr,<<"all">>}],</div><div style="font-family:arial,sans-serif;font-size:13px">
<0.4403.0>,[],all},</div><div style="font-family:arial,sans-serif;font-size:13px"> none,false,rabbit_mirror_queue_master,</div><div style="font-family:arial,sans-serif;font-size:13px">
{state,<0.4404.0>,<0.9085.0>,rabbit_variable_queue,</div><div style="font-family:arial,sans-serif;font-size:13px"> {vqstate,</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {delta,undefined,0,undefined},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,{[],[]}},</div><div style="font-family:arial,sans-serif;font-size:13px">
2114,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {qistate,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/queues/EYHEI3SQW41F6NFSH8WB2CD91",</div><div style="font-family:arial,sans-serif;font-size:13px"> {{dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> []},</div><div style="font-family:arial,sans-serif;font-size:13px"> #Ref<0.0.25.88612>,0,262144,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> #Fun<rabbit_variable_queue.2.36908642>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{client_msstate,msg_store_persistent,</div><div style="font-family:arial,sans-serif;font-size:13px"> <<72,22,217,216,236,0,110,187,235,185,163,249,92,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 182,156,56>>,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {state,696393,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent"},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div><div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_persistent",</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <0.269.0>,700490,692296,704587,708684},</div><div style="font-family:arial,sans-serif;font-size:13px"> {client_msstate,msg_store_transient,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<51,15,67,134,52,182,142,196,131,185,177,5,223,</div><div style="font-family:arial,sans-serif;font-size:13px"> 15,45,61>>,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {state,675908,</div><div style="font-family:arial,sans-serif;font-size:13px">
"/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient"},</div><div style="font-family:arial,sans-serif;font-size:13px"> rabbit_msg_store_ets_index,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> "/var/lib/rabbitmq/mnesia/rabbit@rmq1/msg_store_transient",</div><div style="font-family:arial,sans-serif;font-size:13px"> <0.264.0>,680005,671795,684102,688199}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> true,0,#Fun<rabbit_mirror_queue_slave.1.52898136>,0,</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,infinity,0,0,0,0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px">
{0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0,0,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {rates,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px">
{{1365,529204,602738},0},</div><div style="font-family:arial,sans-serif;font-size:13px"> 0.0,0.0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {1365,529286,74299}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 0,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px">
{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {set,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<0.17350.499>],</div><div style="font-family:arial,sans-serif;font-size:13px">
[<0.17781.499>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.9758.575>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>,<7526.16733.575>],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7525.13515.575>]}}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {[],[]},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined,undefined,undefined,undefined,</div><div style="font-family:arial,sans-serif;font-size:13px">
{state,fine,5000,undefined},</div><div style="font-family:arial,sans-serif;font-size:13px"> {0,nil},</div><div style="font-family:arial,sans-serif;font-size:13px"> 100000,undefined,1365529282744274,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {dict,6,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17350.499>|#Ref<0.0.14563.86478>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<0.17781.499>|#Ref<0.0.14563.86169>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.9758.575>|#Ref<0.0.14563.86395>]],</div><div style="font-family:arial,sans-serif;font-size:13px"> [],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [[<7526.16733.575>|#Ref<0.0.14563.86260>],</div><div style="font-family:arial,sans-serif;font-size:13px"> [<7526.18741.575>|#Ref<0.0.14563.86683>]],</div>
<div style="font-family:arial,sans-serif;font-size:13px"> [],[],[],[],[],[],[],[],</div><div style="font-family:arial,sans-serif;font-size:13px"> [[<7525.13515.575>|#Ref<0.0.14563.86620>]]}}},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> 1,</div><div style="font-family:arial,sans-serif;font-size:13px"> {{0,nil},{0,nil}},</div><div style="font-family:arial,sans-serif;font-size:13px">
undefined,</div><div style="font-family:arial,sans-serif;font-size:13px"> {dict,0,16,16,8,80,48,</div><div style="font-family:arial,sans-serif;font-size:13px"> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},</div><div style="font-family:arial,sans-serif;font-size:13px"> {resource,<<"/fonsyncd/prod/">>,exchange,</div>
<div style="font-family:arial,sans-serif;font-size:13px"> <<"EX-fonsyncd-Exception">>},</div><div style="font-family:arial,sans-serif;font-size:13px"> undefined}]},</div>
<div style="font-family:arial,sans-serif;font-size:13px"> {gen_server2,handle_msg,2},</div><div style="font-family:arial,sans-serif;font-size:13px"> {proc_lib,wake_up,3}]},</div><div style="font-family:arial,sans-serif;font-size:13px">
{gen_server2,call,[<0.4403.0>,{add_on_right,{74,<0.7181.510>}},infinity]}}</div></div><div><br></div></div></div>