<div dir="ltr"><div style>So first, my environment:</div><div style>RabbitMQ 3.0.4</div><div style>Oracle linux 6.2</div><div style>Cluster of 3 nodes, 2 disc, 1 ram.</div><div style><br></div><div style>The problem I'm hitting is I've got one of my nodes hanging and dying. I got it to start and about a minute later it dies again. I have no reports in any log files, and not a clue what the heck is going on. </div>
<div style><br></div><div style>At first, I thought it might be tied to some invalid commands, i.e. rabbitmqctl list_status -p SomeNonExistentQueue (which seems to have problems regardless). That command though works on one of the other nodes.</div>
<br><div style>Any advice here? Nothing as state in the logs. I've hung in various places, for example:</div><div style><div><div>-- rabbit boot start</div><div>starting file handle cache server ...done</div>
<div>starting worker pool ...done</div><div>starting database ...</div><div><br></div></div><div style>I get here and things stop. Other times the whole server starts but then nothing is working. This cluster has been in a good state for weeks and all of a sudden has started doing this. In non detached mode, by starting rabbitmq-server AS root by hand, I have the process running. Below is the results after a rabbitmqctl status that I managed to get before the system crashed, as well as the list of plugins. The last thing in the log file is "Management plugin started. Port: 15672"</div>
<div style><br></div><div style>Thanks for any advice!<br>Jason</div><div style><br></div><div style>{erlang_version,<br></div><div style><div> "Erlang R15B03 (erts-5.9.3.1) [source] [64-bit] [smp:24:24] [async-threads:30] [hipe] [kernel-poll:true]\n"},</div>
<div> {memory,</div><div> [{total,39045064},</div><div> {connection_procs,5664},</div><div> {queue_procs,792848},</div><div> {plugins,163256},</div><div> {other_proc,11498766},</div><div> {mnesia,404168},</div>
<div> {mgmt_db,18304},</div><div> {msg_index,94904},</div><div> {other_ets,1224192},</div><div> {binary,42552},</div><div> {code,18246956},</div><div> {atom,703377},</div><div> {other_system,5850077}]},</div>
<div> {vm_memory_high_watermark,0.4},</div><div> {vm_memory_limit,54118517964},</div><div> {disk_free_limit,1000000000},</div><div> {disk_free,840619569152},</div><div> {file_descriptors,</div><div> [{total_limit,924},{total_used,8},{sockets_limit,829},{sockets_used,1}]},</div>
<div> {processes,[{limit,1048576},{used,316}]},</div><div> {run_queue,0},</div><div> {uptime,14}]</div><div><br></div><div><br></div><div style>HEre's a list of installed plugins:</div><div style><div>[e] amqp_client 3.0.4</div>
<div>[ ] cowboy 0.5.0-rmq3.0.4-git4b93c2d</div><div>[ ] eldap 3.0.4-gite309de4</div><div>[e] mochiweb 2.3.1-rmq3.0.4-gitd541e9a</div><div>[ ] rabbitmq_auth_backend_ldap 3.0.4</div>
<div>[ ] rabbitmq_auth_mechanism_ssl 3.0.4</div><div>[ ] rabbitmq_consistent_hash_exchange 3.0.4</div><div>[E] rabbitmq_federation 3.0.4</div><div>[E] rabbitmq_federation_management 3.0.4</div><div>
[ ] rabbitmq_jsonrpc 3.0.4</div><div>[ ] rabbitmq_jsonrpc_channel 3.0.4</div><div>[ ] rabbitmq_jsonrpc_channel_examples 3.0.4</div><div>[E] rabbitmq_management 3.0.4</div><div>[E] rabbitmq_management_agent 3.0.4</div>
<div>[E] rabbitmq_management_visualiser 3.0.4</div><div>[ ] rabbitmq_mqtt 3.0.4</div><div>[ ] rabbitmq_old_federation 3.0.4</div><div>[E] rabbitmq_shovel 3.0.4</div><div>
[E] rabbitmq_shovel_management 3.0.4</div><div>[ ] rabbitmq_stomp 3.0.4</div><div>[ ] rabbitmq_tracing 3.0.4</div><div>[e] rabbitmq_web_dispatch 3.0.4</div><div>[ ] rabbitmq_web_stomp 3.0.4</div>
<div>[ ] rabbitmq_web_stomp_examples 3.0.4</div><div>[ ] rfc4627_jsonrpc 3.0.4-git7ab174b</div><div>[ ] sockjs 0.3.4-rmq3.0.4-git3132eb9</div><div>[e] webmachine 1.9.1-rmq3.0.4-git52e62bc</div>
<div><br></div></div></div></div></div>