[rabbitmq-discuss] Multiple shovels to increase create a LB queue?

Michael Klishin mklishin at gopivotal.com
Tue Jan 14 06:41:24 GMT 2014


On 14 Jan 2014, at 10:30, Michael Giagnocavo <mgg at giagnocavo.net> wrote:

> Our plan is to make multiple central RabbitMQ servers, and each one will run Shovel and pull from those producing RabbitMQ instances. The idea is that since consumers get load balanced, we can scale horizontally in a nearly “unlimited” fashion just by adding new “central” servers, each shoveling from each producer. And it just requires our consumers to connect to multiple queues, which is no big deal. And each server can run a mirrored queue giving us HA, and if any central server fails, only a part of the capacity is affected.
>  
> Is this a sound approach? Or is there some simpler way?

I’d recommend taking a look at federated queues:
http://www.rabbitmq.com/federated-queues.html

MK

Software Engineer, Pivotal/RabbitMQ




More information about the rabbitmq-discuss mailing list