No subject

Thu Feb 16 03:44:05 GMT 2012

explicitly specified

--047d7b33d9bef7fea004be9d55ad
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div class=3D"gmail_extra">Hi Matthew,<br><br>Thanks for your reply. At lea=
st web UI reports that all 3 nodes are 2.8.1 so I guess they are=A0 up to d=
ate.<br>Reproducing this bug is difficult. I&#39;ll work on it for may be 2=
 more days, trying to find a combination which would be reproducible. Very =
preliminary, I have impression that &quot;exclusive&quot; queue flag have s=
omething to do with it, but I will experiment with ttl too, as you suggeste=
d. <br>
<br>I dont know if it is related, but I had a strange situation when there =
was an exclusive autodelete queue without a connection (connection reported=
 &quot;unknown&quot;) and it was impossible to delete it because &quot;reso=
urce lock&quot; error. <br>
Hopefully I&#39;ll be able to report more tomorrow.<br><br>Thanks,<br>Vadim=
.<br><br><div class=3D"gmail_quote">On Thu, Apr 26, 2012 at 3:31 PM, Matthe=
w Sackman <span dir=3D"ltr">&lt;<a href=3D"mailto:matthew at rabbitmq.com" tar=
get=3D"_blank">matthew at rabbitmq.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Hi Vadim,<br>
<div class=3D"im"><br>
On Thu, Apr 26, 2012 at 01:01:20PM -0700, Vadim Chekan wrote:<br>
&gt; I&#39;m testing my active-active setup (2.8.1, linux 64) and I am rand=
omly<br>
&gt; running into some crashes when I&#39;m stopping a node. I can stop one=
 node<br>
&gt; abut another one fails along with it. Below is a crash log.<br>
&gt;<br>
</div><div class=3D"im">&gt; =3DERROR REPORT=3D=3D=3D=3D 26-Apr-2012::12:15=
:59 =3D=3D=3D<br>
&gt; Discarding message<br>
&gt; {&#39;$gen_call&#39;,{&lt;0.1955.0&gt;,#Ref&lt;0.0.0.5513&gt;},{add_on=
_right,{9,&lt;0.1955.0&gt;}}}<br>
&gt; from &lt;0.1955.0&gt; to &lt;0.26823.834&gt;<br>
&gt; =A0in an old incarnation (2) of this node (3)<br>
<br>
</div>I&#39;m worried about these messages. Someone else on this list has s=
een<br>
this sort of thing too and it&#39;s causing them trouble. I&#39;ve not seen=
 this<br>
issue myself in testing which is frustrating. However, that&#39;s not the<b=
r>
cause of your crash in this case (I think).<br>
<div class=3D"im"><br>
&gt; ** Generic server &lt;0.1800.0&gt; terminating<br>
&gt; ** Last message in was {&#39;$gen_cast&#39;,{gm_deaths,[&lt;0.4684.0&g=
t;]}}<br>
&gt; ** When Server state =3D=3D {state,<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {amqqueue,<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {resou=
rce,&lt;&lt;&quot;/&quot;&gt;&gt;,queue,&lt;&lt;&quot;test_29&quot;&gt;&gt;=
},<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 true,f=
alse,&lt;0.1433.0&gt;,<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [{&lt;=
&lt;&quot;x-ha-policy&quot;&gt;&gt;,longstr,&lt;&lt;&quot;all&quot;&gt;&gt;=
},<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{&l=
t;&lt;&quot;x-message-ttl&quot;&gt;&gt;,signedint,600000}],<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 &lt;0.=
1799.0&gt;,[],all},<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 &lt;0.1801.0&g=
t;,<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {dict,0,16,16,=
8,80,48,<br>
&gt;<br>
&gt; {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[]}=
,<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {{[],[=
],[],[],[],[],[],[],[],[],[],[],[],[],<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 []=
,[]}}},<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun&lt;rabbit=
_mirror_queue_master.1.2951048&gt;,<br>
&gt; =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun&lt;rabbit=
_mirror_queue_master.2.72654940&gt;}<br>
&gt; ** Reason for termination =3D=3D<br>
&gt; ** {{case_clause,{ok,&lt;3066.9234.0&gt;,[&lt;0.4683.0&gt;]}},<br>
&gt; =A0 =A0 [{rabbit_mirror_queue_coordinator,handle_cast,2},<br>
&gt; =A0 =A0 =A0{gen_server2,handle_msg,2},<br>
&gt; =A0 =A0 =A0{proc_lib,wake_up,3}]}<br>
<br>
</div>Well this is very odd. We fixed a bug that looked like this, but it g=
ot<br>
fixed in 2.7.1 (and related to x-ha-policy =3D nodes. Could you just check<=
br>
that you really are running 2.8.1? We&#39;re not aware of any bug in this<b=
r>
area in 2.8.1, but that&#39;s certainly not saying there&#39;s not one ther=
e! Is<br>
there any particular sequence of events that you can perform that<br>
reliably triggers this crash? Could you also check the logs of the other<br=
>
nodes (both .log and -sasl.log) to see if there&#39;s further crash reports=
<br>
in there?<br>
<br>
Also, there have been discovered lots of bugs relating to the code<br>
changes made to add DLX support in 2.8.1, especially in relation to HA.<br>
It&#39;s possible one of the issues I found with TTL and HA is causing this=
.<br>
2.8.2 should be out soonish which might introduce fewer new bugs than it<br=
>
fixes, but in the mean time, could you try without the TTL and see if<br>
that helps?<br>
<br>
Matthew<br>
_______________________________________________<br>
rabbitmq-discuss mailing list<br>
<a href=3D"mailto:rabbitmq-discuss at lists.rabbitmq.com">rabbitmq-discuss at lis=
ts.rabbitmq.com</a><br>
<a href=3D"https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-dis=
cuss" target=3D"_blank">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo=
/rabbitmq-discuss</a><br>
</blockquote></div><br><br clear=3D"all"><br>-- <br>From RFC 2631: In ASN.1=
, EXPLICIT tagging is implicit unless IMPLICIT is explicitly specified<br>
</div>

--047d7b33d9bef7fea004be9d55ad--