Simon,<div><br></div><div>Thank you very much for your reply.</div><div><br></div><div><p class="MsoNormal" style="font-size:13px;color:rgb(34,34,34);font-family:arial,sans-serif;background-color:rgb(255,255,255)">�<u></u></p>
<p class="MsoNormal" style="font-size:13px;color:rgb(34,34,34);font-family:arial,sans-serif;background-color:rgb(255,255,255)">Using HIPE compilation reduced the flow control significantly.I now get flow controlled at around 4.1 MB/S to 7.2 MB/S .However flow control �seems�to steadily remain on at 3.8MB/s for the rest of the time RabbitMQ runs.</p>
<p class="MsoNormal" style="font-size:13px;color:rgb(34,34,34);font-family:arial,sans-serif;background-color:rgb(255,255,255)"><br></p><p class="MsoNormal" style="font-size:13px;color:rgb(34,34,34);font-family:arial,sans-serif;background-color:rgb(255,255,255)">
Each message is about approximately 300 bytes at most 800 bytes</p></div><div><br></div><div><p class="MsoNormal" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
Multiple connections(independent applications) will be made from the same host to the RabbitMQ Server. Each connection will be sending small messages really fast to the broker(RabbitMQ Server)<u></u><u></u></p>
<p class="MsoNormal" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)"><u></u>�<u></u></p><p class="MsoNormal" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
What optimizations can be made to increase throughput on RabbitMQ Server or �<span style="background-color:transparent">the routing part of the pipeline ? Would cluster be the next option to evaluate ?</span></p><p class="MsoNormal" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<u></u>�<u></u></p><p class="MsoNormal" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)"><u></u>�<u></u></p><font color="#222222" face="arial, sans-serif">Is there any output that i can gather to analyze which part of the�pipeline�is the bottleneck ?</font><br>
<p class="MsoNormal" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)"><br></p><p class="MsoNormal" style="background-color:rgb(255,255,255)">--</p><p class="MsoNormal" style="background-color:rgb(255,255,255)">
Dwayne</p></div><div><br></div><div><br><div class="gmail_quote">On Fri, Oct 12, 2012 at 7:14 AM, Simon MacMullen <span dir="ltr"><<a href="mailto:simon@rabbitmq.com" target="_blank">simon@rabbitmq.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On 11/10/12 13:14, Dwayne Campbell wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Guys,<br>
<br>
RabbitMQ now turns on flow control often even at 1.5 MB/s. �I have read<br>
before to increase the TCP buffer size, however I do not have access to<br>
increase the TCP buffer size o the machines.<br>
<br>
How can i disable Per-Connection Flow Control ? � Memory based �and Disk<br>
based control is enough for me.<br>
</blockquote>
<br>
Hi. You should be aware that the flow control is indicating that some part of the message pipeline is overloaded. If you were to turn off flow control it would just lead to messages backing up ahead of that part of the pipeline - leading to memory use ballooning very rapidly and no increase in throughput.<br>
<br>
If you are sending lots of tiny messages then the routing part of the pipeline can be the most expensive - my workstation manages only about 2.5MB/s with zero-length messages.<br>
<br>
The advice about increasing the buffer size is to allow your machine to handle short bursts of messages, at higher rates than it can manage in a steady state. It won't get you a higher steady state rate.<br>
<br>
To process messages faster on a single machine you might enable HiPE compilation: see <a href="http://www.rabbitmq.com/configure.html" target="_blank">http://www.rabbitmq.com/<u></u>configure.html</a><br>
<br>
Cheers, Simon<span><font color="#888888"><br>
<br>
-- <br>
Simon MacMullen<br>
RabbitMQ, VMware<br>
</font></span></blockquote></div><br></div>