[rabbitmq-discuss] Backing up persisted messages

[Beth Jones]

Thanks Tim.

Specifically I have a queue that is accumulating messages and I'm worried about those messages being deleted accidentally.  I want to be able to back up that queue on a regular basis (say daily or hourly) to a location on disk.  

I read about copying the mnesia directory.  Does that copy all the data for all of the queue on that node?  Is there something similar that is queue specific?

Beth



On 30 Jan 2014, at 17:04, Tim Watson wrote:

> It really depends on what you mean by "backup". What are you trying to achieve? Do you need resiliency (i.e., avoiding data loss), are you trying to conserve disk space, or is there some other requirement at play?
> 
> For resiliency, clustering + HA offers a good set of guarantees if you're on a reliable network. You can also use the shovel and/or federation plugins to replicate messages between RabbitMQ nodes. The only other alternative would be backing up the mnesia directory, but that would copy all the data for all queues (and a bunch of other stuff too).
> 
> I'd suggest looking at the shovel or federation plugins. You can replicate data and handle it differently depending on your needs, e.g., to archive messages you want to deal with much later on, you might consume the replicated messages and archive them to a persistent storage medium of your choice, to be "replayed" later.
> 
> http://www.rabbitmq.com/distributed.html is probably worth a read. 
> 
> Cheers,
> Tim
> 
> On 30 Jan 2014, at 16:39, Beth Jones wrote:
> 
>> Hello
>> 
>> What's the best way to backup persistent messages?  I have a queue that contains messages that aren't being consumed and I want to create a back up of them.
>> 
>> Thanks in advance.
>> 
>> Beth
>> 
>> -- 
>> The Wellcome Trust Sanger Institute is operated by Genome Research 
>> Limited, a charity registered in England with number 1021457 and a 
>> company registered in England with number 2742969, whose registered 
>> office is 215 Euston Road, London, NW1 2BE. 
>> _______________________________________________
>> rabbitmq-discuss mailing list
>> rabbitmq-discuss at lists.rabbitmq.com
>> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
> 
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss



-- 
 The Wellcome Trust Sanger Institute is operated by Genome Research 
 Limited, a charity registered in England with number 1021457 and a 
 company registered in England with number 2742969, whose registered 
 office is 215 Euston Road, London, NW1 2BE.