<div dir="ltr">I won't be able to test it in the same production environment but should be able to reproduce the behavior in a test environment. I'm travelling tomorrow afternoon, so if you don't hear from me by end of business UK time tomorrow, I'll definitely have something for you Monday.<div>
<br></div><div>Thanks so much for all your help. :)</div><div><br></div><div style>Best, Travis</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Jun 19, 2013 at 10:34 AM, Simon MacMullen <span dir="ltr"><<a href="mailto:simon@rabbitmq.com" target="_blank">simon@rabbitmq.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Also, I have a patched version of the management plugin which fixes the leak I found today:<br>
<br>
<a href="http://www.rabbitmq.com/releases/plugins/v3.1.1/rabbitmq_management-3.1.1-leakfix1.ez" target="_blank">http://www.rabbitmq.com/<u></u>releases/plugins/v3.1.1/<u></u>rabbitmq_management-3.1.1-<u></u>leakfix1.ez</a><br>
<br>
(see <a href="http://www.rabbitmq.com/plugins.html#installing-plugins" target="_blank">http://www.rabbitmq.com/<u></u>plugins.html#installing-<u></u>plugins</a> for where to put it, it replaces rabbitmq_management-3.1.1.ez)<br>
<br>
If you are able to test this version, that would also be great.<br>
<br>
Cheers, Simon<br>
<br>
On 19/06/13 15:57, Simon MacMullen wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Thanks.<br>
<br>
Could you run<br>
<br>
rabbitmqctl eval<br>
'{_,_,_,[_,_,_,_,[_,_,{_,[{_,<u></u>S}]}]]}=sys:get_status(global:<u></u>whereis_name(rabbit_mgmt_db)),<u></u>T=element(5,S),ets:foldl(fun(<u></u>E,_)->io:format("~p~n~n",[E])<u></u>end,[],T).'<br>
<br>
<br>
please? This will dump the entire leaky table to standard output, so you<br>
would want to redirect it to a file.<br>
<br>
If you could also accompany that with "rabbitmqctl report" so I can see<br>
what actually exists at that time then I can at least see what is leaking.<br>
<br>
Cheers, Simon<br>
<br>
On 19/06/13 15:30, Travis Mehlinger wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Simon,<br>
<br>
We aren't doing anything like that. Whenever one of our services starts<br>
(which are based on Kombu, if that helps), it plucks a connection from<br>
its internal pool, creates a channel on that connection, then binds on<br>
its request queue, which hangs around until the service stops. The only<br>
thing that deviates from this pattern is our monitor, which connects and<br>
disconnects fairly rapidly, and uses exclusive queues.<br>
<br>
That said, it's entirely possible that we have something floating around<br>
that I don't know about that fits the behavior you described. I'll keep<br>
digging and see what I can turn up. In the meantime, let me know if<br>
there's any more information I can collect from Rabbit.<br>
<br>
Thanks, Travis<br>
<br>
<br>
On Wed, Jun 19, 2013 at 6:13 AM, Simon MacMullen <<a href="mailto:simon@rabbitmq.com" target="_blank">simon@rabbitmq.com</a><br>
<mailto:<a href="mailto:simon@rabbitmq.com" target="_blank">simon@rabbitmq.com</a>>> wrote:<br>
<br>
On 18/06/13 16:11, Travis Mehlinger wrote:<br>
<br>
We declare those queues as exclusive so they're getting<br>
cleaned up<br>
automatically.<br>
<br>
<br>
I have found a plausible candidate for the leak. But it's dependent<br>
on having a long lived channel which declares and deletes lots of<br>
short-lived queues. We keep some information on the deleted queues<br>
until the channel is closed. Could your monitoring tool be doing<br>
that? Obviously it would have to be deleting queues explicitly, not<br>
relying on them being exclusive.<br>
<br>
Cheers, Simon<br>
<br>
<br>
--<br>
Simon MacMullen<br>
RabbitMQ, Pivotal<br>
<br>
<br>
</blockquote>
<br>
<br><span class="HOEnZb"><font color="#888888">
</font></span></blockquote><span class="HOEnZb"><font color="#888888">
<br>
<br>
-- <br>
Simon MacMullen<br>
RabbitMQ, Pivotal<br>
</font></span></blockquote></div><br></div>