[rabbitmq-discuss] configure external data store(like database) for message durability in rabbitmq

[PATAR, SAGAR]

Thanks.. We don't want to handle the storage through code .. we wanted to see if rabbit mq has some option where we can point it to a database so the messages gets stored during the node crash's so that the other nodes in the cluster can pick the message and process ..

We are looking at a design where we have a clustered env with multiple nodes and has a single DB for message durability so that node failures doesn't delay the message processing ... My assumption is when we have a file store for message durability and if one of the node goes down in the cluster the messages not been consumed yet must have been stored in that node file system and will stay till the node is back up ... those message will not be accessible by other active nodes in the cluster because the file store for that node is not accessible to other nodes....and the messages will be delayed ...

I am not sure how this scenario is handled ...seems to be a common problem..

-----Original Message-----
From: rabbitmq-discuss-bounces at lists.rabbitmq.com [mailto:rabbitmq-discuss-bounces at lists.rabbitmq.com] On Behalf Of Michael Klishin
Sent: Monday, September 30, 2013 10:58 AM
To: Discussions about RabbitMQ
Subject: Re: [rabbitmq-discuss] configure external data store(like database) for message durability in rabbitmq


On sep 30, 2013, at 6:37 p.m., "PATAR, SAGAR" <sp345s at att.com> wrote:

> Looks like Rabbit MQ support external different backing stores / databases for message durability..  I couldn't find any help/document/tutorial on how to use or configure external database instead of default file store.. Have anyone implemented this if so how does the performance look..
> Any help is highly appreciated

Take a look at [1] and [2].

Implementing your own storage is possible but is not trivial and likely will not be worth the effort
for most projects. Using a custom message index implementation to reduce RAM
usage is much easier, see [2].

1. http://www.rabbitmq.com/blog/2011/01/20/rabbitmq-backing-stores-databases-and-disks/
2. http://hg.rabbitmq.com/rabbitmq-toke/

MK