<p class="p1">I was confused by the problem when the rabbitmq cluster(3 nodes 167/188/218, mirrored quque) was running, suddenly maybe an network io error happened, then the cluster broker into two(167-188 and 218), each of them was confirmed running and able to serve but also consider the reason of cluster breaking was not their own fault and always waited for the other node to join back again.</p>
<p class="p2"><br></p>
<p class="p1">Any clue?</p>
<p class="separator" style="text-align: center; clear: both;"><a imageanchor="1" href="https://lh4.googleusercontent.com/-d-tKvmnFwDI/USHHKY29EmI/AAAAAAAAAF4/yWudeT64Ats/s1600/%E5%B1%8F%E5%B9%95%E5%BF%AB%E7%85%A7+2013-02-17+%E4%B8%8B%E5%8D%886.39.44.png" style="margin-left: 1em; margin-right: 1em;"><img style="" src="https://lh4.googleusercontent.com/-d-tKvmnFwDI/USHHKY29EmI/AAAAAAAAAF4/yWudeT64Ats/s320/%E5%B1%8F%E5%B9%95%E5%BF%AB%E7%85%A7+2013-02-17+%E4%B8%8B%E5%8D%886.39.44.png" border="0" width="320" height="269"></a></p><p class="p2"><br></p>
<p class="p2"><br></p>
<p class="p1">218 consider 167and188 down, and it's master now.</p>
<p class="p2"><br></p>
<p class="separator" style="text-align: center; clear: both;"><a imageanchor="1" href="https://lh5.googleusercontent.com/-53xWkDetMEg/USHHZpnFYoI/AAAAAAAAAGA/iysXsLTEzlU/s1600/%E5%B1%8F%E5%B9%95%E5%BF%AB%E7%85%A7+2013-02-17+%E4%B8%8B%E5%8D%886.39.23.png" style="margin-left: 1em; margin-right: 1em;"><img style="" src="https://lh5.googleusercontent.com/-53xWkDetMEg/USHHZpnFYoI/AAAAAAAAAGA/iysXsLTEzlU/s320/%E5%B1%8F%E5%B9%95%E5%BF%AB%E7%85%A7+2013-02-17+%E4%B8%8B%E5%8D%886.39.23.png" border="0" width="304" height="320"></a></p><p class="p2"><br></p>
<p class="p2"><br></p>
<p class="p2"><br></p>
<p class="p1">167 and 188 both consider 218 down</p>
<p class="p2"><br></p>
<p class="p1">And the cluster_status command returns</p><p class="separator" style="text-align: center; clear: both;"><a imageanchor="1" href="https://lh4.googleusercontent.com/-lmk5YAZrNJM/USHHjmq8voI/AAAAAAAAAGI/HtJf3HWTAJU/s1600/%E5%B1%8F%E5%B9%95%E5%BF%AB%E7%85%A7+2013-02-17+%E4%B8%8B%E5%8D%8810.42.33.png" style="margin-left: 1em; margin-right: 1em;"><img style="" src="https://lh4.googleusercontent.com/-lmk5YAZrNJM/USHHjmq8voI/AAAAAAAAAGI/HtJf3HWTAJU/s320/%E5%B1%8F%E5%B9%95%E5%BF%AB%E7%85%A7+2013-02-17+%E4%B8%8B%E5%8D%8810.42.33.png" border="0" width="320" height="108"></a></p><p class="p1"><br></p>