<div dir="ltr">Hi Simon, Tim,<div><br></div><div>Thanks for your replies and effort analysing my query.</div><div><br></div><div>On Riak we have experienced stability issues when large data is being transferred. I am not too sure the exact root cause, but we see busy_dist_port messages then one of the Riak nodes crashes and has to be restarted by Chef. Increasing "+zdbbl 18432" resolved this issue.</div>
<div><br></div><div style>This contains more information about Riak and this setting</div><div style><a href="http://boundary.com/blog/2012/09/26/incuriosity-killed-the-infrastructur/">http://boundary.com/blog/2012/09/26/incuriosity-killed-the-infrastructur/</a><br>
</div><div><br></div><div style>We have not seen any stability issues with our use of RabbitMQ to date. After our Riak experience I was concerned if our RabbitMQ usage pattern changes over time (for example message sizes increase), we could experience similar stability issues too. If there is a chance of this I would like to be warned before its a problem.</div>
<div style><br></div><div style>Iain.</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">On 21 May 2013 15:38, Simon MacMullen <span dir="ltr"><<a href="mailto:simon@rabbitmq.com" target="_blank">simon@rabbitmq.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
To add to what Tim said: I've run some tests with busy_dist_port monitoring patched into RabbitMQ and while I can certainly see busy_dist_port messages, I haven't been able to demonstrate any improvement in throughput by tweaking zdbbl until they went away - so I don't see the point in exposing them.<br>
<br>
Out of interest, did you see a performance improvement in Riak after modifying zdbbl, or were you just trying to make the warnings go away? :-)<br>
<br>
Cheers, Simon<div><div class="h5"><br>
<br>
On 20/05/13 12:15, Iain Hull wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5">
We are in the process of deploying a Riak cluster, and are wondering if<br>
some of the lessons we learned monitoring Erlang in Riak should be<br>
applied to RabbitMQ.<br>
<br>
During testing we noticed a lot of busy_dist_port in the logs, the root<br>
was cause was a the Erlang kernel parameter zdbbl was set too low. We<br>
have adjusted the parameter and are now monitoring the logs for<br>
busy_dist_port errors.<br>
<br>
I have searched the RabbitMQ mailing list for cases of busy_dist_port or<br>
zdbbl, but cannot find any. I am wondering if RabbitMQ can suffer from<br>
problems with busy_dist_port or if zdbbl should be set to any particular<br>
value? Or I should I monitor the RabbitMQ logs for busy_dist_port?<br>
<br>
Thanks,<br>
Iain.<br>
<br>
--<br>
Iain Hull<br>
Senior Software Engineer<br>
iain.hull.workday (Skype)<br>
</div></div><a href="mailto:iain.hull@workday.com" target="_blank">iain.hull@workday.com</a> <mailto:<a href="mailto:iain.hull@workday.com" target="_blank">iain.hull@workday.com</a>><br>
<br>
<<a href="http://www.workday.com/signature-uk" target="_blank">http://www.workday.com/<u></u>signature-uk</a>><div class="im"><br>
<br>
<br>
______________________________<u></u>_________________<br>
rabbitmq-discuss mailing list<br>
<a href="mailto:rabbitmq-discuss@lists.rabbitmq.com" target="_blank">rabbitmq-discuss@lists.<u></u>rabbitmq.com</a><br>
<a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/<u></u>cgi-bin/mailman/listinfo/<u></u>rabbitmq-discuss</a><br>
<br>
</div></blockquote><span class="HOEnZb"><font color="#888888">
<br>
<br>
-- <br>
Simon MacMullen<br>
RabbitMQ, Pivotal<br>
</font></span></blockquote></div><br><br clear="all"><div><br></div>-- <br><span style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif;font-size:12px">Iain Hull</span><br style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif;font-size:12px">
<span style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif;font-size:12px">Senior Software Engineer</span><br style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif;font-size:12px"><span style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif;font-size:12px">iain.hull.workday (Skype)</span><br style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif;font-size:12px">
<a href="mailto:iain.hull@workday.com" style="font-family:Arial,Helvetica,sans-serif;font-size:12px" target="_blank">iain.hull@workday.com</a><br style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif;font-size:12px">
<br style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif;font-size:12px"><a href="http://www.workday.com/signature-uk" style="font-family:Arial,Helvetica,sans-serif;font-size:12px" target="_blank"><img src="http://www.workday.com/pics/common/signature-logo.gif" border="0"></a><br>
</div>