Thanks Tim! I realize that all issues take time to fix, and certainly don't expect instant turnaround.<br><br>In the absence of a reply, I just wanted to make sure the issue was driven to some sort of resolution ("user error", "bug", "stray photon", etc...).<br>
<br>Matt<br><br><div class="gmail_quote">On Tue, Aug 28, 2012 at 11:24 AM, Tim Watson <span dir="ltr"><<a href="mailto:tim@rabbitmq.com" target="_blank">tim@rabbitmq.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word"><div>Hi Matt,</div><div><br></div><div>Matthias has identified the cause of this and a bug has been raised to fix it. I presume this will go into a bugfix release asap, but don't take that as gospel as that decision hasn't been made yet. We certainly haven't forgot about this, that's for sure! :)</div>
<div><br></div><div>Cheers,</div><div>Tim</div><br><div><div><div class="h5"><div>On 28 Aug 2012, at 19:12, Matt Pietrek wrote:</div><br></div></div><blockquote type="cite"><div><div class="h5">Just pinging this thread as it seems to have gone dead, and it feels like a serious issue with clustering/HA in 2.8.6.<br>
<br>When we last left off, Matthias had asked for the logs for the two other brokers when the queue disappeared. My last message contained the contents of those logs.<br>
<br>Thanks,<br><br>Matt<br><br><div class="gmail_quote">On Fri, Aug 24, 2012 at 11:22 AM, Matt Pietrek <span dir="ltr"><<a href="mailto:mpietrek@skytap.com" target="_blank">mpietrek@skytap.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>> The logs for play and util from around the same time might offer us some more clues.</div><span><font color="#888888"><br>
<br>What I sent was <a href="mailto:rabbit@play.log" target="_blank">rabbit@play.log</a>.<br><br><a href="mailto:rabbit@play2.log" target="_blank">rabbit@play2.log</a> doesn't look nearly as interesting:<div><br>
<br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>Limiting to approx 924 file handles (829 sockets)<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>Memory limit set to 399MB of 999MB total.<div>
<br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>
Disk free limit set to 100MB<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>Management plugin upgraded statistics to fine.<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br>
</div>msg_store_transient: using rabbit_msg_store_ets_index to provide index<div><br>
<br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>msg_store_persistent: using rabbit_msg_store_ets_index to provide index<br><br>=WARNING REPORT==== 24-Aug-2012::10:29:12 ===<br>msg_store_persistent: recovery terms differ from present<br>
rebuilding indices from scratch<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>Adding mirror of queue 'unit_test' in vhost '/' on node rabbit@play2: <0.261.0><div>
<br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>
Adding mirror of queue 'test' in vhost '/' on node rabbit@play2: <0.263.0><div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>Adding mirror of queue 'XXXX' in vhost '/' on node rabbit@play2: <0.266.0><div>
<br>
<br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>Adding mirror of queue 'XYZZY' in vhost '/' on node rabbit@play2: <0.268.0><div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br>
</div>Adding mirror of queue 'system_test' in vhost '/' on node rabbit@play2: <0.271.0><div><br>
<br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>started TCP Listener on <a href="http://0.0.0.0:5672/" target="_blank">0.0.0.0:5672</a><div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>rabbit on node rabbit@play up<div>
<br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>
rabbit on node rabbit@util up<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>Management agent started.<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br></div>Management plugin started. Port: 55672, path: /<br>
<br>And here is <a href="mailto:rabbit@util.log" target="_blank">rabbit@util.log</a><div><br>
=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br></div>Mirrored-queue (queue 'charon' in vhost '/'): Slave <rabbit@util.3.262.0> saw deaths of mirrors <rabbit@play2.2.271.0> <br><div><br>
=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br></div>
Mirrored-queue (queue 'charon' in vhost '/'): Promoting slave <rabbit@util.3.262.0> to master<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br></div>Mirrored-queue (queue 'system_test' in vhost '/'): Slave <rabbit@util.3.264.0> saw deaths of mirrors <rabbit@play2.2.273.0> <br>
<div>
<br>=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br></div>Mirrored-queue (queue 'system_test' in vhost '/'): Promoting slave <rabbit@util.3.264.0> to master<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br>
rabbit on node rabbit@play2 down<br><br>=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br></div>Mirrored-queue (queue 'cmcmd' in vhost '/'): Slave <rabbit@util.3.258.0> saw deaths of mirrors <rabbit@play2.2.267.0> <br>
<div>
<br>=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br></div>Mirrored-queue (queue 'cmcmd' in vhost '/'): Promoting slave <rabbit@util.3.258.0> to master<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br>
</div>Mirrored-queue (queue 'ConfigurationManager' in vhost '/'): Slave <rabbit@util.3.260.0> saw deaths of mirrors <rabbit@play2.2.269.0> <br><div>
<br>=INFO REPORT==== 24-Aug-2012::10:29:06 ===<br></div>Mirrored-queue (queue 'ConfigurationManager' in vhost '/'): Promoting slave <rabbit@util.3.260.0> to master<div><br><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br>
</div>
Mirrored-queue (queue 'unit_test' in vhost '/'): Master <rabbit@util.3.2457.0> saw deaths of mirrors <rabbit@play2.3.261.0> <br><div><br>=INFO REPORT==== 24-Aug-2012::10:29:12 ===<br>
rabbit on node rabbit@play2 up<br>
<br><br></div></font></span><div><div><br><div class="gmail_quote">On Fri, Aug 24, 2012 at 10:51 AM, Matthias Radestock <span dir="ltr"><<a href="mailto:matthias@rabbitmq.com" target="_blank">matthias@rabbitmq.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Matt,<div><br>
<br>
On 24/08/12 18:34, Matt Pietrek wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I was able to reproduce this in exactly the same way with 2.8.6 and<br>
Erlang R15B01.<br>
</blockquote>
<br></div>
Thanks.<div><br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Here's the log from <a href="mailto:rabbit@play.log" target="_blank">rabbit@play.log</a>. When play2 goes down and comes back<br>
up, the 'unit_test' queue (the only queue with messages) disappears.<br>
</blockquote>
<br></div>
Just to confirm, the queues are mirrored across *three* nodes - play, play2 and util, right?<br>
<br>
The logs for play and util from around the same time might offer us some more clues.<span><font color="#888888"><br>
<br>
Matthias.<br>
</font></span></blockquote></div><br>
</div></div></blockquote></div><br></div></div>
_______________________________________________<br>rabbitmq-discuss mailing list<br><a href="mailto:rabbitmq-discuss@lists.rabbitmq.com" target="_blank">rabbitmq-discuss@lists.rabbitmq.com</a><br><a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a><br>
</blockquote></div><br></div><br>_______________________________________________<br>
rabbitmq-discuss mailing list<br>
<a href="mailto:rabbitmq-discuss@lists.rabbitmq.com">rabbitmq-discuss@lists.rabbitmq.com</a><br>
<a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a><br>
<br></blockquote></div><br>