<div dir="ltr">Hi Matthias,<div><br></div><div>There is no other vhosts. I can't keep the problem for investigation since it is a production server. "rabbitmqctl stop_app; rabbitmqctl start_app" frees the memory.</div>
<div><br></div><div>I am new to rabbit and this is just one of a series problems I meet. I am not sure whether it helps but I am going to list the problems I experienced to provide more context.<br><div class="gmail_extra">
<br></div><div class="gmail_extra">Environment:</div><div class="gmail_extra" style>- Debian 7.1</div><div class="gmail_extra">- A cluster with 3 servers</div><div class="gmail_extra">- A virtual ip is assigned to the servers, using keepalive to shift the virtual ip(automatic)<br>
- use default exchange</div><div class="gmail_extra" style>- 6 queues (<span style="font-family:arial,sans-serif;font-size:12.727272033691406px">ha.snssdk.log, </span><span style="font-family:arial,sans-serif;font-size:12.727272033691406px">ha.snssdk.log.dispatch, </span><span style="font-family:arial,sans-serif;font-size:12.727272033691406px">ha.snssdk.log.output, </span><span style="font-family:arial,sans-serif;font-size:12.727272033691406px">ssesion, session.log, session.output</span>), queues whose name begin with 'ha.' are mirrored queues</div>
<div class="gmail_extra" style>- all queues and messages are none-durable</div><div class="gmail_extra" style>- message publish rate: 4000 ~ 10000 msg/s</div><div class="gmail_extra" style><br></div><div class="gmail_extra" style>
Problems(with actions I took):</div><div class="gmail_extra" style>1. Initially use rabbit version 3.1.1, the rabbit server crash with message like following sometime: <span style="font-family:arial,sans-serif;font-size:12.727272033691406px">Slogan: std_alloc: Cannot allocate 1119579832804544 bytes of memory (of type </span><span style="font-size:12.727272033691406px;font-family:arial,sans-serif">"arg_reg").</span> </div>
<div class="gmail_extra" style> - action: upgrade both rabbit and erlang to the latest version.</div><div class="gmail_extra" style>2. rabbit take up to much memory</div><div class="gmail_extra" style> - action: rabbitmqctl stop_app; rabbitmqctl start_app</div>
<div class="gmail_extra" style>3. block on declaring queue '<span style="font-family:arial,sans-serif;font-size:12.727272033691406px">ha.snssdk.log.dispatch</span>', but it is OK to declare other queues, including '<span style="font-family:arial,sans-serif;font-size:12.727272033691406px">ha.snssdk.log.dispatch2</span>'</div>
<div class="gmail_extra" style> - action: stop rabbit, remove mnesia folder, start rabbit and rebuild the cluster.</div><div class="gmail_extra" style>4. the management_plugin doesn't work, with message like "<span style="color:rgb(72,72,72);font-family:Verdana,sans-serif;font-size:12px">TypeError: Cannot read property 'connections' of undefined</span>"</div>
<div class="gmail_extra" style> - action: asking in maillist but no action is taken so far</div><div class="gmail_extra" style>5. though all the queues and messages are none-durable, and the memory consumption is far below configured by 'vm_memory_high_watermark', the mnesia folder sometimes can take up much space(e.g. 19G), it is basically taken by 'msg_store_transient' folder. I don't understand why.</div>
<div class="gmail_extra" style> - action: none</div><div class="gmail_extra" style>6. sometimes rabbit doesn't push message to consumers in time: I found some consumers don't get message from time to time even there are messages in the queue. But this seems to be transient (lasting for about 1 minute). </div>
<div class="gmail_extra" style> - action: none</div><div class="gmail_extra" style><br></div><div class="gmail_extra" style>Thanks.</div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jul 11, 2013 at 12:55 AM, Matthias Radestock <span dir="ltr"><<a href="mailto:matthias@rabbitmq.com" target="_blank">matthias@rabbitmq.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div class="im">On 09/07/13 15:59, Rubo Liang wrote:<br>
</div><div class="im"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
My rabbit eats 25G memory, but the queues don't take to much as shown by<br>
this command: 'rabbitmqctl list_queues name messages memory':<br>
Listing queues ...<br>
ha.snssdk.log 695954 16426216<br>
ha.snssdk.log.dispatch 660748 102698808<br>
ha.snssdk.log.output 63573 32800680<br>
ssesion 0 25952<br>
ssesion.log 101 436328<br>
ssesion.output 0 148816<br>
...done.<br>
<br>
As shown above the queues only take about 150M memory. But the rabbit<br>
process actually takes about 25G.<br>
<br>
'rabbitmqctl status' gives me following output on memory:<br>
<br>
{memory,<br>
[{total,25394382848},<br>
{connection_procs,140253648},<br>
{queue_procs,19311874888},<br>
</blockquote>
<br></div>
So that shows queue processes taking up 19G. Perhaps you have queue's in vhosts other than '/'? Note that 'rabbitmqctl list_queues' only shows information on one vhost ('/' by default).<span class=""><font color="#888888"><br>
<br>
Matthias.<br>
</font></span></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr">梁汝波<div>手机：+86-18600464396</div><div>地址：<span style="color:rgb(0,0,0);font-family:Arial,Helvetica,FreeSans,sans-serif;font-size:13.63636302947998px;line-height:15.454545021057129px">北京市海淀区知春路甲48号盈都大厦B座10层</span></div>
<div><font face="Arial, Helvetica, FreeSans, sans-serif"><span style="line-height:17px">邮编：100088</span></font></div><div><font face="Arial, Helvetica, FreeSans, sans-serif"><span style="line-height:17px"><br></span></font></div>
</div>
</div></div></div>