No subject
Thu Feb 16 03:44:05 GMT 2012
explicitly specified
--047d7b15ab85e34dc204bee8284e
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Thanks for looking into it Matthias,<br><br>"rabbitmq-dev": yes, =
it is load balancer.<br>Disconnects: I was too lazy to write code for it an=
d just restarted client manually.<br>I did make a short try to reproduce fa=
ilure without any load but it worked just fine. I'll try more today.<br=
>
<br>Vadim.<br><br><div class=3D"gmail_quote">On Sat, Apr 28, 2012 at 12:13 =
AM, Matthias Radestock <span dir=3D"ltr"><<a href=3D"mailto:matthias at rab=
bitmq.com" target=3D"_blank">matthias at rabbitmq.com</a>></span> wrote:<br=
><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1=
px #ccc solid;padding-left:1ex">
Vadim,<br>
<br>
(putting the list back on cc)<div class=3D"im"><br>
<br>
On 27/04/12 23:28, Vadim Chekan wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
I've spent some time today playing with different client settings. Seem=
s<br>
ttl does not affect failures at all.<br>
</blockquote>
<br></div>
That's good to know. The more factors we can eliminate as possible caus=
es the better.<div class=3D"im"><br>
<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
I managed to reproduce crash many times today. Basic idea is: an<br>
application, 40 threads create a pub/sub exchange and publish a message<br>
every second. Under this load I bring the master node (all queues are<br>
usually created on the same node) and often it causes another node to<br>
fail. Here is my load simulator (in c#):<br>
<a href=3D"http://www.heypasteit.com/clip/0B5W" target=3D"_blank">http://ww=
w.heypasteit.com/<u></u>clip/0B5W</a><br>
</blockquote>
<br></div>
That code connects to "rabbitmq-dev". Is that a load balancer sit=
ting in front of the three nodes?<br>
<br>
How do you deal with the disconnects resulting from the shutting down of no=
des? There doesn't seem to be any code to handle that.<br>
<br>
Mind you, I suspect that the failure should still be reproducible without a=
ny subscriptions and publishes. Would be good to try that and just watch th=
e broker logs for errors.<div class=3D"im"><br>
<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
As long as maillist does not allow zip attaches, I'm mailing to you guy=
s<br>
directly<br>
</blockquote>
<br></div>
Thanks for posting these. There is an error in the logs that we haven't=
seen before:<br>
<br>
=A0 =A0 =A0 =A0 =A0 {{badmatch,[]},<br>
=A0 =A0 =A0 =A0 =A0 =A0[{rabbit_mirror_queue_misc,'-<u></u>remove_from=
_queue/2-fun-0-',2}<u></u>,<br>
=A0 =A0 =A0 =A0 =A0 =A0 {mnesia_tm,apply_fun,3},<br>
=A0 =A0 =A0 =A0 =A0 =A0 {mnesia_tm,execute_<u></u>transaction,5},<br>
=A0 =A0 =A0 =A0 =A0 =A0 {rabbit_misc,'-execute_mnesia_<u></u>transacti=
on/1-fun-0-',1},<br>
=A0 =A0 =A0 =A0 =A0 =A0 {worker_pool_worker,handle_<u></u>call,3},<br>
=A0 =A0 =A0 =A0 =A0 =A0 {gen_server2,handle_msg,2},<br>
=A0 =A0 =A0 =A0 =A0 =A0 {proc_lib,wake_up,3}]}<br>
<br>
Looking at the code, this appears to indicate that there are no master/mirr=
or processes left for the queue. Which is...unexpected. That should give us=
something to go on.<br>
<br>
Regards,<br>
<br>
Matthias.<br>
</blockquote></div><br><br clear=3D"all"><br>-- <br>From RFC 2631: In ASN.1=
, EXPLICIT tagging is implicit unless IMPLICIT is explicitly specified<br>
--047d7b15ab85e34dc204bee8284e--
More information about the rabbitmq-discuss
mailing list