[rabbitmq-discuss] Recovering an 3-node cluster after power failure

Simon MacMullen simon at rabbitmq.com
Mon May 20 14:55:34 BST 2013


On 20/05/13 14:48, Samuel Winchenbach wrote:
> Thanks Simon,
>
> So deleting the mnesia directory effectively removes all of the cluster
> configuration correct (policies for example)?

Yes, it's exactly equivalent to "rabbitmqctl reset".

> I could use the second method you mentioned and remove the two nodes
> causing me issue, start and reset them, finally  cluster them to the
> only running node?

Also an option.

Cheers, Simon

>
> Thanks for the tips!
>
> Sam
>
>
> On Mon, May 20, 2013 at 8:35 AM, Simon MacMullen <simon at rabbitmq.com
> <mailto:simon at rabbitmq.com>> wrote:
>
>     Hi.
>
>     If you just want to do the equivalent of "rabbitmqctl reset" with a
>     node down, then deleting the Mnesia directory (see
>     RABBITMQ_MNESIA_BASE in http://www.rabbitmq.com/__relocate.html
>     <http://www.rabbitmq.com/relocate.html> for location) is the
>     simplest thing to do.
>
>     If you want to remove a node from a cluster and the lack of that
>     node is preventing you from starting the cluster, you can set
>     RABBITMQ_NODE_ONLY for another node, and then invoke "rabbitmqctl
>     forget_cluster_node" against that.
>
>     Cheers, Simon
>
>
>     On 17/05/13 20:32, Sam Winchenbach wrote:
>
>         Hi All,
>
>         I have a three node cluster running on VMs for testing purposes:
>         node1 (disk)
>         node2(disk)
>         node3(ram)
>
>         Today we had a power outage and all the nodes went down at once.
>           I am
>         having a serious issue recovering from this because node1 thinks it
>         belongs to a cluster but node3 disagrees.   I can not seem to do
>         anything at all with rabbitmq on node1.   If I try running running
>         "rabbitmqctl reset" it can not connect because node1 is down.
>           How can I
>         recover from this gracefully?
>
>         Thanks,
>         Sam
>
>
>         _________________________________________________
>         rabbitmq-discuss mailing list
>         rabbitmq-discuss at lists.__rabbitmq.com
>         <mailto:rabbitmq-discuss at lists.rabbitmq.com>
>         https://lists.rabbitmq.com/__cgi-bin/mailman/listinfo/__rabbitmq-discuss
>         <https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss>
>
>
>
>     --
>     Simon MacMullen
>     RabbitMQ, Pivotal
>
>


-- 
Simon MacMullen
RabbitMQ, Pivotal


More information about the rabbitmq-discuss mailing list