<div dir="ltr">For the meantime I have left the FD as they are. After renaming the mnesia database the server has been running for the last two hours with no issues, but that could also be that I rebooted the machine earlier as well, and there may be a FD leak somewhere.<div>
<br></div><div>I also found the following error in the rabbit log as part of the crashes; not sure if this relates to FDs:</div><div><br></div><div><div><br></div><div>=ERROR REPORT==== 22-Jan-2014::14:54:02 ===</div><div>
** Generic server <0.197.0> terminating</div><div>** Last message in was {'$gen_cast',{combine,29089,29088}}</div><div>** When Server state == {state,</div><div> {dict,0,16,16,8,80,48,</div>
<div> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div> []},</div><div> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>
<div> [],[]}}},</div><div> [],</div><div> {gc_state,</div><div> "/var/lib/rabbitmq/mnesia/rabbit@queue1/msg_store_persistent",</div>
<div> rabbit_msg_store_ets_index,</div><div> {state,233541,</div><div> "/var/lib/rabbitmq/mnesia/rabbit@queue1/msg_store_persistent"},</div>
<div> 229444,237638,<0.194.0>}}</div><div>** Reason for termination ==</div><div>** {{badmatch,{error,system_limit}},</div><div> [{rabbit_msg_store,combine_files,3},</div><div> {rabbit_msg_store_gc,attempt_action,3},</div>
<div> {rabbit_msg_store_gc,handle_cast,2},</div><div> {gen_server2,handle_msg,2},</div><div> {proc_lib,wake_up,3}]}</div><div><br></div><div>=ERROR REPORT==== 22-Jan-2014::14:54:02 ===</div><div>** Generic server msg_store_persistent terminating</div>
<div>** Last message in was {'EXIT',<0.197.0>,</div><div> {{badmatch,{error,system_limit}},</div><div> [{rabbit_msg_store,combine_files,3},</div><div>
{rabbit_msg_store_gc,attempt_action,3},</div><div> {rabbit_msg_store_gc,handle_cast,2},</div><div> {gen_server2,handle_msg,2},</div>
<div> {proc_lib,wake_up,3}]}}</div><div>** When Server state == {msstate,</div><div> "/var/lib/rabbitmq/mnesia/rabbit@queue1/msg_store_persistent",</div>
<div> rabbit_msg_store_ets_index,</div></div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Jan 23, 2014 at 10:54 AM, Matthias Radestock <span dir="ltr"><<a href="mailto:matthias@rabbitmq.com" target="_blank">matthias@rabbitmq.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">On 22/01/14 21:38, Daniel Bason wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I have raised the limits now to 4096. I'm not sure why this started<br>
becoming an issue now after 6 months of stability, but we'll try it out.<br>
</blockquote>
<br></div>
It would be good to get a status report after 90 minutes, to see what the file descriptor situation looks like then.<br>
<br>
It is quite unusual for rabbit to actually die due to insufficient FDs; normally it will just refuse to accept more connections.<br>
<br>
I do notice that you are running quite an old Erlang. Definitely worth upgrading.<span class="HOEnZb"><font color="#888888"><br>
<br>
Matthias.</font></span><div class="HOEnZb"><div class="h5"><br>
______________________________<u></u>_________________<br>
rabbitmq-discuss mailing list<br>
<a href="mailto:rabbitmq-discuss@lists.rabbitmq.com" target="_blank">rabbitmq-discuss@lists.<u></u>rabbitmq.com</a><br>
<a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/<u></u>cgi-bin/mailman/listinfo/<u></u>rabbitmq-discuss</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><div style="font-family:Verdana,Helvetica,Arial,sans-serif;font-size:13px;line-height:16px;text-align:left;background-color:rgb(255,255,255)">
<b>Dan Bason </b></div><div style="font-family:Verdana,Helvetica,Arial,sans-serif;font-size:13px;line-height:16px;text-align:left;background-color:rgb(255,255,255)">Infrastructure Engineer – Telogis </div><div style="font-family:Verdana,Helvetica,Arial,sans-serif;font-size:13px;line-height:16px;text-align:left;background-color:rgb(255,255,255)">
<div style="font-family:'Open Sans',sans-serif"><a href="http://www.telogis.com" target="_blank">www.telogis.com</a> <a href="http://www.telogis.co.nz" target="_blank">www.telogis.co.nz</a> </div><div style="font-family:'Open Sans',sans-serif">
+1 201 477-1448 (USA) +64 3 281-8065 (NZ) </div><div style="font-family:'Open Sans',sans-serif"><br></div><div style="font-family:'Open Sans',sans-serif"><p style="font-family:arial,sans-serif;font-size:12.727272033691406px;line-height:normal">
</p><p style="margin:0px"><a href="http://www.google.com/url?q=http%3A%2F%2Fwww.telogis.com%2F&sa=D&sntz=1&usg=AFrqEze6z4qIWKcAMjgXqM25xkuw9JMysQ" style="font-family:arial;font-size:small;color:rgb(74,146,193)!important" target="_blank"><img src="http://www.telogis.com/images/telogis-logo-black-sm.png" style="border:none;padding:0px"></a></p>
<br style="color:rgb(0,0,0);font-family:arial;font-size:small"><i style="color:rgb(0,0,0);font-family:arial;font-size:small">One Platform for Location Intelligence</i><span style="color:rgb(0,0,0);font-family:arial;font-size:small"> </span><br>
<p></p></div></div></div>
</div>
<br>
<p><span style="color:gray"><font size="1">This e-mail,
and any attachments, is intended only for use by the addressee(s) named herein
and may contain legally privileged and/or confidential information. It is
the property of Telogis. If you are not the intended recipient of this
e-mail, you are hereby notified that any dissemination, distribution or copying
of this e-mail, any attachments thereto, and use of the information contained,
is strictly prohibited. If you have received this e-mail in error, please
notify the sender and permanently delete the original and any copy thereof.</font></span><span style="font-size:1.3em;font-size:1.3em"></span></p>