Hello,<div><br></div><div>I get the following error when one of the nodes in the cluster lost its connectivity (RabbitMQ <b>2.8.6</b> on Erlang <b>R14B04)</b>. After that the cluster became useless until we restarted all nodes in the cluster. Few questions:</div>
<div><br></div><div>1. Do we need to increase the ETS table limit from 1400? we have several thousands mirrored queues and several hundreds of consumer/producers.</div><div>2. How does rabbit uses ETS table (e.g. one per queue, one per connection)?</div>
<div>3. Is there a command to show how many ETS tables are in use?</div><div>4. What is the current timeout for detecting other nodes in the cluster and can it be increased?</div><div><br></div><div>Thanks,</div><div>Farshad</div>
<div><br></div><div><br></div><div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div><div>** Node rabbit@rmq2 not responding **</div><div>** Removing (timedout) connection **</div><div><br></div><div>=INFO REPORT==== 16-Nov-2012::17:31:42 ===</div>
<div>rabbit on node rabbit@rmq2 down</div><div><br></div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div><div>** Too many db tables **</div><div><br></div><div><br></div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div>
<div>** Too many db tables **</div><div><br></div><div><br></div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div><div>** Too many db tables **</div><div><br></div><div><br></div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div>
<div>** Too many db tables **</div></div><div><br></div><div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div><div>** Generic server <0.786.0> terminating</div><div>** Last message in was {'DOWN',#Ref<0.0.0.68136>,process,<7526.761.0>,</div>
<div> noconnection}</div><div>** When Server state == {state,</div><div> {7,<0.786.0>},</div><div> {{80,<7525.8408.0>},#Ref<0.0.0.54136>},</div>
<div> {{10,<7526.761.0>},#Ref<0.0.0.68136>},</div><div> {resource,<<"/fonsyncd/prod/">>,queue,</div><div> <<"Q-SID.16499.fonsyncd">>},</div>
<div> rabbit_mirror_queue_slave,</div><div> {11,</div><div> [{{7,<0.786.0>},</div><div> {view_member,</div>
<div> {7,<0.786.0>},</div><div> [],</div><div> {80,<7525.8408.0>},</div><div> {10,<7526.761.0>}}},</div>
<div> {{10,<7526.761.0>},</div><div> {view_member,</div><div> {10,<7526.761.0>},</div><div> [],</div>
<div> {7,<0.786.0>},</div><div> {80,<7525.8408.0>}}},</div><div> {{80,<7525.8408.0>},</div><div> {view_member,</div>
<div> {80,<7525.8408.0>},</div><div> [],</div><div> {10,<7526.761.0>},</div><div> {7,<0.786.0>}}}]},</div>
<div> 0,</div><div> [{{7,<0.786.0>},{member,{[],[]},0,0}},</div><div> {{10,<7526.761.0>},{member,{[],[]},0,0}},</div><div> {{80,<7525.8408.0>},</div>
<div> {member,{[],[]},59944,59944}}],</div><div> [<0.784.0>],</div><div> {[],[]},</div><div> [],undefined}</div>
</div><div><br></div><div><div>** Reason for termination ==</div><div>** {{badmatch,</div><div> {aborted,</div><div> {system_limit,</div><div> "Cannot create an ets table for the local transaction store",</div>
<div> {system_limit,</div><div> [{ets,new,[mnesia_trans_store,[bag,public]]},</div><div> {mnesia_tm,doit_loop,1},</div><div> {mnesia_sp,init_proc,4},</div>
<div> {proc_lib,init_p_do_apply,3}]}}}},</div><div> [{gm,record_dead_member_in_group,2},</div><div> {gm,handle_info,2},</div><div> {gen_server2,handle_msg,2},</div><div> {proc_lib,wake_up,3}]}</div>
<div><br></div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div><div>** Too many db tables **</div><div><br></div><div><br></div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div><div>** Too many db tables **</div>
<div><br></div><div><br></div><div>=ERROR REPORT==== 16-Nov-2012::17:31:42 ===</div><div>** Generic server <0.4528.0> terminating</div><div>** Last message in was {'DOWN',#Ref<0.0.0.78137>,process,<7526.4380.0>,</div>
<div> noconnection}</div></div><div><br></div>