<div dir="ltr"><div>On my last test attempt, this is what I received in the rabbitmq log</div><div><br></div><div><div>=WARNING REPORT==== 11-Sep-2013::16:02:40 ===</div><div>file descriptor limit alarm set.</div><div><br>
</div><div>********************************************************************</div><div>*** New connections will not be accepted until this alarm clears ***</div><div>********************************************************************</div>
</div><div><br></div><div><br></div>After running 2 separate loads with only 1 thread driving the load, 500 msgs ran on the producer and 500 were consumed. on the second, only 230 ran... totalling 730 which gets close to the default connection limit. Apparently I'm doing something wrong with my Producer connections.<div>
<br></div><div>I've set the FD limit on the linux server to something abnormally high (1024000), so it shouldn't be the OS causing the problem.<br><div><br></div><div>And just to close the loop.... problem is solved now. I was creating a new connection for each sent message and not closing it. The proper way to do it is to create one shared connection and open new channels on that connection for each send. The thing to remember is to close the connections on client reset.</div>
<div><br></div><div>Thanks for your help!</div>
</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Sep 11, 2013 at 10:44 AM, Michael Klishin <span dir="ltr"><<a href="mailto:mklishin@gopivotal.com" target="_blank">mklishin@gopivotal.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Sean Stephens:<br>
<br>
> My belief at this point is that my producer load has overrun the connection factory pool in writing to the queues.<br>
><br>
> I have been unable to locate information on settings related to the connection factory pool to make it larger or change the timeout. When the connections do timeout, it doesn't look like the pool catches up unless I kill the Producer application. Anyone have advice on how to get past this issue?<br>
<br>
ConnectionFactory does not pool connections. Can you take a look at rabbitmq log to see if<br>
there are any warnings about alarms and blocked publishers?<br>
<br>
> Is there a way to throttle the load at the Producer connection, or will it be necessary to just add more nodes to handle the incoming load?<br>
<br>
You can implement throttling logic in your own code but in general, you need to have enough<br>
consumer capacity to keep up with producers, or RabbitMQ will block connections that publish<br>
(there will be a very visible warning in the log).<br>
<span class="HOEnZb"><font color="#888888"><br>
MK<br>
<br>
<br>
<br>
</font></span></blockquote></div><br></div>