<div dir="ltr"><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">i have tried again the scenario 1 as mentioned in earlier post and i have seen loss of messages by running the following scenario.</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"><br></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">Code of sender and recevier is taken from here</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
<a href="http://www.rabbitmq.com/tutorials/tutorial-one-java.html" target="_blank">http://www.rabbitmq.com/tutorials/tutorial-one-java.html</a></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
<br></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">1) I have set the the vm memory high watermark as 0.0 using sudo rabbitmqctl set_vm_memory_high_watermark 0.0</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
and this was the rabbitmq status</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"><br></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">[{pid,18011},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {running_applications,[{rabbit,"RabbitMQ","3.2.0"},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{os_mon,"CPO CXC 138 46","2.2.7"},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {xmerl,"XML parser","1.2.10"},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {mnesia,"MNESIA CXC 138 12","4.5"},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{sasl,"SASL CXC 138 11","2.1.10"},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {stdlib,"ERTS CXC 138 10","1.17.5"},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {kernel,"ERTS CXC 138 10","2.14.5"}]},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{os,{unix,linux}},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {erlang_version,"Erlang R14B04 (erts-5.8.5) [source] [smp:4:4] [rq:4] [async-threads:30] [kernel-poll:true]\n"},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {memory,[{total,36566880},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {connection_procs,4412},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {queue_procs,7584},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {plugins,0},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{other_proc,4730524},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {mnesia,30868},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{mgmt_db,0},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {msg_index,3304196},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {other_ets,14336920},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {binary,4477424},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {code,7676827},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{atom,907549},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {other_system,1090576}]},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{vm_memory_high_watermark,0.0},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {vm_memory_limit,0},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {disk_free_limit,10180000000},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {disk_free,12359700480},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {file_descriptors,[{total_limit,924},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {total_used,4},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {sockets_limit,829},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {sockets_used,1}]},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {processes,[{limit,1048576},{used,127}]},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {run_queue,0},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {uptime,454}]</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
<br></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">2) Now i sent messages to the queue in a loop of 100000</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
but i could see publish messages successful till 1435 and then publish( ) gets blocked.</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">i have stopped the sender now.</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
i have run listqueues command and i could see 0 messages in the queue</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"><br></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
3) I have set the the vm memory high watermark as 0.4 using sudo rabbitmqctl set_vm_memory_high_watermark 0.4</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"><br></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
<div class="gmail_extra">4) i have run listqueues command again expecting the 1435 messages</div><div class="gmail_extra">but i have seen 0 messages in queue.</div><div class="gmail_extra">and now i have run receiver but no received message in the log.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra"><br></div></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">and this was the rabbitmq status</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
<br></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">[{pid,18011},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {running_applications,[{rabbit,"RabbitMQ","3.2.0"},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {os_mon,"CPO CXC 138 46","2.2.7"},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{xmerl,"XML parser","1.2.10"},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {mnesia,"MNESIA CXC 138 12","4.5"},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {sasl,"SASL CXC 138 11","2.1.10"},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{stdlib,"ERTS CXC 138 10","1.17.5"},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {kernel,"ERTS CXC 138 10","2.14.5"}]},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {os,{unix,linux}},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {erlang_version,"Erlang R14B04 (erts-5.8.5) [source] [smp:4:4] [rq:4] [async-threads:30] [kernel-poll:true]\n"},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {memory,[{total,134642952},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {connection_procs,5920},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {queue_procs,80505068},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {plugins,0},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {other_proc,4761592},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {mnesia,30868},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {mgmt_db,0},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {msg_index,3304196},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{other_ets,14336920},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {binary,22022520},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
{code,7676827},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {atom,907549},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {other_system,1091492}]},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {vm_memory_high_watermark,0.4},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {vm_memory_limit,1650614272},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {disk_free_limit,10180000000},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {disk_free,12359540736},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {file_descriptors,[{total_limit,924},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {total_used,4},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {sockets_limit,829},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {sockets_used,1}]},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {processes,[{limit,1048576},{used,127}]},</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {run_queue,0},</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> {uptime,702}]</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">...done.</div><div class="gmail_extra"><br><br>
<div class="gmail_quote">On Mon, Dec 30, 2013 at 3:33 PM, sandeep kumar <span dir="ltr"><<a href="mailto:sandy.sandeeep@gmail.com" target="_blank">sandy.sandeeep@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div dir="ltr">Hi ,<div><br></div><div>I have used single rabbitmq node , And I set memory_high_watermark to a small value(0.05)</div><div>and messages are being sent to the rabbitmq node at a higher rate.</div><div>When memory is about to be breached because of higher rate of messages to the node creation of .rdq files is observed.</div>
<div>when the memory consumtion crosses the limit all connections to the node getting blocked is observed.</div><div>At this point of time there is neither increase in queue size nor .rdq size, but publish to queue statemt is getting executed.</div>
<div><br></div><div>Questions are :</div><div><br></div><div>where are the published messages are getting store when connections to queue are in blocked state</div><div><br></div><div>how to handle this kind of scenario gracefully</div>
<div><br></div></div>
</blockquote></div><br></div></div>