<div dir="ltr">More investigation...  R16B01 installs here:<div>/usr/lib/erlang/erts-5.10.2/</div><div><br></div><div style>A ps auf shows /usr/lib/erlang/erts-5.9.3.1/bin/epmd -daemon as still running.  SO I&#39;m wondering if that might have an impact.  Note here&#39;s how I&#39;m doing my install:</div>
<div style><br></div><div style>stop rabbit on server X (upgrader is Z, other node is Y)<br></div><div style>remove all rabbit/erlang RPM&#39;s</div><div style>Reinstall rabbit software</div><div style>Update rabbitmqadmin</div>
<div style>Enable management plugins (just in case)</div><div style>Enable auto start.</div><div style><br></div><div style>Rinse and repeat on servers Y, then Z and then start bringing them up starting with upgrader node. First start Z, then start Y, then start X.</div>
<div style>Jason</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Aug 23, 2013 at 4:51 PM, Jason McIntosh <span dir="ltr">&lt;<a href="mailto:mcintoshj@gmail.com" target="_blank">mcintoshj@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Here&#39;s some other details from the logs if it might help (note I discovered the web-gui issue was a cache issue):<div>
<br></div><div><div>=INFO REPORT==== 23-Aug-2013::15:37:43 ===</div><div>upgrades: Mnesia dir backed up to &quot;/data/rabbitmq/rabbitmq/mnesia/cluster-upgrade-backup&quot;</div>
<div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:43 ===</div><div>mnesia upgrades: 1 to apply</div><div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:43 ===</div><div>mnesia upgrades: Breaking cluster</div><div>

<br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:43 ===</div><div>mnesia upgrades: Applying rabbit_upgrade_functions:exchange_decorators</div><div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:43 ===</div><div>mnesia upgrades: All upgrades applied successfully</div>

<div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:44 ===</div><div>Starting RabbitMQ 3.1.5 on Erlang R16B01</div><div>Copyright (C) 2007-2013 GoPivotal, Inc.</div><div>Licensed under the MPL.  See <a href="http://www.rabbitmq.com/" target="_blank">http://www.rabbitmq.com/</a></div>

<div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:44 ===</div><div>node           : cluster@rabbitmqm10t</div><div>home dir       : /var/lib/rabbitmq</div><div>config file(s) : (none)</div><div>cookie hash    : 9fmMn2E9ImSXspwK+tgGgQ==</div>

<div>log            : /data/rabbitmq/cluster.log</div><div>sasl log       : /data/rabbitmq/cluster-sasl.log</div><div>database dir   : /data/rabbitmq/rabbitmq/mnesia/cluster</div><div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:45 ===</div>

<div>Limiting to approx 924 file handles (829 sockets)</div><div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:45 ===</div><div>upgrades: Mnesia backup removed</div><div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:45 ===</div>

<div>Memory limit set to 396MB of 991MB total.</div><div><br></div><div>=INFO REPORT==== 23-Aug-2013::15:37:45 ===</div><div>Disk free limit set to 1000MB</div></div><div><br></div></div><div class="HOEnZb"><div class="h5">
<div class="gmail_extra"><br><br><div class="gmail_quote">
On Fri, Aug 23, 2013 at 4:21 PM, Jason McIntosh <span dir="ltr">&lt;<a href="mailto:mcintoshj@gmail.com" target="_blank">mcintoshj@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

<div dir="ltr">We just upgraded our Alpha environment to 3.1.5 and Erlang R16B01.  In the process, ALL of our queue definitions disappeared.  Checking logs, I get a  whole lot of errors like the below (names redacted).  Thankfully, I can auto-generate all the stuff again, but I&#39;m having errors on my &quot;upgrader&quot; node right now that is preventing it from even working - the webgui gives a &quot;<span style="color:rgb(72,72,72);font-family:Verdana,sans-serif;font-size:12px">ReferenceError: queue_length is not defined&quot; error and doesn&#39;t display any information. Note, I followed the instructions - picked an upgrader node, shutdown all the other nodes in order, brought the &quot;upgrader&quot; node back online, then the others in sequential order.  This has me really really spooked though.</span><div>


<font color="#484848" face="Verdana, sans-serif"><span style="font-size:12px"><br></span></font></div><div><font color="#484848" face="Verdana, sans-serif"><span style="font-size:12px">Any advice??<br>Thanks!<br>Jason<br>


</span></font><div><br></div><div><div>=ERROR REPORT==== 23-Aug-2013::15:37:50 ===</div><div>** Generic server &lt;0.303.0&gt; terminating</div><div>** Last message in was {&#39;EXIT&#39;,&lt;0.350.0&gt;,normal}</div><div>


** When Server state == {q,</div><div>                         {amqqueue,</div><div>                          {resource,&lt;&lt;&quot;EXCHANGE&quot;&gt;&gt;,queue,</div><div>                           &lt;&lt;&quot;QUEUE&quot;&gt;&gt;},</div>


<div>                          true,false,none,</div><div>                          [{&lt;&lt;&quot;x-ha-policy&quot;&gt;&gt;,longstr,&lt;&lt;&quot;all&quot;&gt;&gt;}],</div><div>                          &lt;0.303.0&gt;,[],[],</div>


<div>                          [{vhost,&lt;&lt;&quot;pca&quot;&gt;&gt;},</div><div>                           {name,&lt;&lt;&quot;HA&quot;&gt;&gt;},</div><div>                           {pattern,&lt;&lt;&quot;^(?!amq\\.).*&quot;&gt;&gt;},</div>


<div>                           {definition,[{&lt;&lt;&quot;ha-mode&quot;&gt;&gt;,&lt;&lt;&quot;all&quot;&gt;&gt;}]},</div><div>                           {priority,0}],</div><div>                          [{&lt;0.261.0&gt;,&lt;0.260.0&gt;},</div>


<div>                           {&lt;0.308.0&gt;,&lt;0.260.0&gt;},</div><div>                           {&lt;0.299.0&gt;,&lt;0.258.0&gt;},</div><div>                           {&lt;0.562.0&gt;,&lt;0.561.0&gt;}]},</div><div>


                         none,false,rabbit_mirror_queue_master,</div><div>                         {state,</div><div>                          {resource,&lt;&lt;&quot;EXCHANGE&quot;&gt;&gt;,queue,</div><div>                           &lt;&lt;&quot;QUEUE&quot;&gt;&gt;},</div>


<div>                          &lt;0.351.0&gt;,&lt;0.350.0&gt;,rabbit_variable_queue,</div><div>                          {vqstate,</div><div>                           {0,{[],[]}},</div><div>                           {0,{[],[]}},</div>


<div>                           {delta,0,0,0},</div><div>                           {0,{[],[]}},</div><div>                           {0,{[],[]}},</div><div>                           0,</div><div>                           {0,nil},</div>


<div>                           {0,nil},</div><div>                           {qistate,</div><div>                            &quot;/data/rabbitmq/rabbitmq/mnesia/cluster/queues/8FHU53A729K2C3KLMS8XPVKJD&quot;,</div><div>


                            {{dict,0,16,16,8,80,48,</div><div>                              {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div>                               []},</div><div>                              {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>


<div>                                []}}},</div><div>                             []},</div><div>                            #Ref&lt;0.0.0.1702&gt;,0,65536,</div><div>                            #Fun&lt;rabbit_variable_queue.2.81334491&gt;,</div>


<div>                            {0,nil}},</div><div>                           {{client_msstate,msg_store_persistent,</div><div>                             &lt;&lt;247,77,14,2,221,67,18,168,38,83,171,47,207,31,</div><div>


                               187,253&gt;&gt;,</div><div>                             {dict,0,16,16,8,80,48,</div><div>                              {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div>                               []},</div>


<div>                              {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div>                                []}}},</div><div>                             {state,450623,</div><div>                              &quot;/data/rabbitmq/rabbitmq/mnesia/cluster/msg_store_persistent&quot;},</div>


<div>                             rabbit_msg_store_ets_index,</div><div>                             &quot;/data/rabbitmq/rabbitmq/mnesia/cluster/msg_store_persistent&quot;,</div><div>                             &lt;0.301.0&gt;,454733,446535,458830,462927},</div>


<div>                            {client_msstate,msg_store_transient,</div><div>                             &lt;&lt;12,4,24,179,230,120,71,131,21,190,238,120,9,176,</div><div>                               231,238&gt;&gt;,</div>


<div>                             {dict,0,16,16,8,80,48,</div><div>                              {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div><div>                               []},</div><div>                              {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],</div>


<div>                                []}}},</div><div>                        undefined,undefined,undefined,running}</div><div>** Reason for termination ==</div><div>** {{badmatch,{error,not_found}},</div><div>    [{rabbit_mirror_queue_master,stop_all_slaves,2,[]},</div>


<div>     {rabbit_mirror_queue_master,delete_and_terminate,2,[]},</div><div>     {rabbit_amqqueue_process,&#39;-terminate_delete/3-fun-1-&#39;,6,[]},</div><div>     {rabbit_amqqueue_process,terminate_shutdown,2,[]},</div>


<div>     {gen_server2,terminate,3,[]},</div><div>     {proc_lib,wake_up,3,[{file,&quot;proc_lib.erl&quot;},{line,249}]}]}</div><div>** In &#39;terminate&#39; callback with reason ==</div><div>** normal</div><span><font color="#888888"><div>

<br></div>
<div><br></div>-- <br>Jason McIntosh<br><a href="http://mcintosh.poetshome.com/blog/" target="_blank">http://mcintosh.poetshome.com/blog/</a><br><a href="tel:573-424-7612" value="+15734247612" target="_blank">573-424-7612</a>
</font></span></div></div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br>Jason McIntosh<br><a href="http://mcintosh.poetshome.com/blog/" target="_blank">http://mcintosh.poetshome.com/blog/</a><br><a href="tel:573-424-7612" value="+15734247612" target="_blank">573-424-7612</a>
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Jason McIntosh<br><a href="http://mcintosh.poetshome.com/blog/">http://mcintosh.poetshome.com/blog/</a><br>573-424-7612
</div>