[rabbitmq-discuss] Rabbitmq crashing every 90 minutes

[Daniel Bason]

For the meantime I have left the FD as they are.  After renaming the mnesia
database the server has been running for the last two hours with no issues,
but that could also be that I rebooted the machine earlier as well, and
 there may be a FD leak somewhere.

I also found the following error in the rabbit log as part of the crashes;
not sure if this relates to FDs:


=ERROR REPORT==== 22-Jan-2014::14:54:02 ===
** Generic server <0.197.0> terminating
** Last message in was {'$gen_cast',{combine,29089,29088}}
** When Server state == {state,
                            {dict,0,16,16,8,80,48,

{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
                                 []},
                                {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],
                                  [],[]}}},
                            [],
                            {gc_state,
                                "/var/lib/rabbitmq/mnesia/rabbit at queue1
/msg_store_persistent",
                                rabbit_msg_store_ets_index,
                                {state,233541,
                                    "/var/lib/rabbitmq/mnesia/rabbit at queue1
/msg_store_persistent"},
                                229444,237638,<0.194.0>}}
** Reason for termination ==
** {{badmatch,{error,system_limit}},
    [{rabbit_msg_store,combine_files,3},
     {rabbit_msg_store_gc,attempt_action,3},
     {rabbit_msg_store_gc,handle_cast,2},
     {gen_server2,handle_msg,2},
     {proc_lib,wake_up,3}]}

=ERROR REPORT==== 22-Jan-2014::14:54:02 ===
** Generic server msg_store_persistent terminating
** Last message in was {'EXIT',<0.197.0>,
                               {{badmatch,{error,system_limit}},
                                [{rabbit_msg_store,combine_files,3},
                                 {rabbit_msg_store_gc,attempt_action,3},
                                 {rabbit_msg_store_gc,handle_cast,2},
                                 {gen_server2,handle_msg,2},
                                 {proc_lib,wake_up,3}]}}
** When Server state == {msstate,
                            "/var/lib/rabbitmq/mnesia/rabbit at queue1
/msg_store_persistent",
                            rabbit_msg_store_ets_index,



On Thu, Jan 23, 2014 at 10:54 AM, Matthias Radestock
<matthias at rabbitmq.com>wrote:

> On 22/01/14 21:38, Daniel Bason wrote:
>
>> I have raised the limits now to 4096.  I'm not sure why this started
>> becoming an issue now after 6 months of stability, but we'll try it out.
>>
>
> It would be good to get a status report after 90 minutes, to see what the
> file descriptor situation looks like then.
>
> It is quite unusual for rabbit to actually die due to insufficient FDs;
> normally it will just refuse to accept more connections.
>
> I do notice that you are running quite an old Erlang. Definitely worth
> upgrading.
>
> Matthias.
>
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>



-- 
*Dan Bason *
Infrastructure Engineer – Telogis
www.telogis.com  www.telogis.co.nz
+1 201 477-1448 (USA)  +64 3 281-8065 (NZ)

<http://www.google.com/url?q=http%3A%2F%2Fwww.telogis.com%2F&sa=D&sntz=1&usg=AFrqEze6z4qIWKcAMjgXqM25xkuw9JMysQ>

*One Platform for Location Intelligence*

-- 


This e-mail, and any attachments, is intended only for use by the 
addressee(s) named herein and may contain legally privileged and/or 
confidential information.  It is the property of Telogis.  If you are not 
the intended recipient of this e-mail, you are hereby notified that any 
dissemination, distribution or copying of this e-mail, any attachments 
thereto, and use of the information contained, is strictly prohibited.  If 
you have received this e-mail in error, please notify the sender and 
permanently delete the original and any copy thereof.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20140123/eed0a2f8/attachment.html>