On Tue, Nov 13, 2012 at 12:24 PM, Simon MacMullen <span dir="ltr"><<a href="mailto:simon@rabbitmq.com" target="_blank">simon@rabbitmq.com</a>></span> wrote:<br><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="im">On 13/11/12 10:35, Irmo Manie wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I'm still seeing this behavior and it seems to get worse.<br>
Every hour there is a drop in delivery rate to 0 and now also the<br>
publish rate drops to 0.<br>
Sometimes even for a period of 5 minutes<br>
<br>
I'm really sure that messaging continues and the statistics are a lie.<br>
We use rabbitmq as our main communication hub and certainly a drop in<br>
real-time market data going from ~500 msg/s to 0 for about 5 minutes<br>
must be noticed somewhere if this is true.<br>
<br>
I'm wondering if it might be the writing part of the statistics to the<br>
database. Could that timeout?<br>
</blockquote>
<br></div>
No.<br>
<br>
But if the database is busy with something else then it could take a while to process the updates it's received. I find it hard to believe that it could be busy for 5 minutes though.<br>
<br>
There is nothing scheduled once an hour in RabbitMQ though - so whatever is happening once an hour must be outside the broker. Figuring out what that is would help a lot.<div class="im"><br></div></blockquote><div><br></div>
<div>Clear :-)</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I don't really want to restart to see if that fixes the problem.<br>
It's been running for 177 days now and apart from the weird statistics<br>
we don't have any problems.<br>
<br>
Is there anything I could do as additional checks to figure out where<br>
the problem might be?<br>
</blockquote>
<br></div>
Just to be clear: is this just the rates in /api/overview or the ones in /api/queues as well?<br>
<br></blockquote><div><br></div><div>Both show 0 as the rates</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I'd also be interested to see the output of:<br>
<br>
rabbitmqctl eval 'process_info(global:whereis_<u></u>name(rabbit_mgmt_db), [message_queue_len,status, current_stacktrace]).'<br>
<br>
when the statistics drop to 0.<div class="HOEnZb"><div class="h5"><br></div></div></blockquote><div><br></div><div>I'll try to check this and let you know if I find anything weird</div><div><br></div><div>Thanks so far for the information and help.</div>
<div><br></div><div>- Irmo</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">
<br>
Cheers, Simon<br>
<br>
-- <br>
Simon MacMullen<br>
RabbitMQ, VMware<br>
</div></div></blockquote></div><br></div>