[rabbitmq-discuss] Multiple shovels to increase create a LB queue?

Tue Jan 14 06:54:34 GMT 2014

What's the rea difference? It seems if I declare all the upstreams on a few downstream queues, it's the same as shoveling. Except shoveling gets the messages out immediately, instead of on-demand. I've read the comparisons and other docs, but it's not quite clear. And federation can connect the multiple central brokers together, but I'm not sure that really helps us - every consumer can connect to every central.

The only other point of info was a message from Simon saying:

"Since federation has quite a pull-based model it might prove more fiddly 
to use than shovel in a situation where you have a lot of satellite 
brokers publishing to a central broker."

Our satellites are all over the world, over unstable IPSec links, FWIW.

We also plan on setting up mirrored queues for HA, if that changes anything (seems it'd be transparent, at least to shoveling).

Thank you,
-Michael

-----Original Message-----
From: rabbitmq-discuss [mailto:rabbitmq-discuss-bounces at lists.rabbitmq.com] On Behalf Of Michael Klishin
Sent: Monday, January 13, 2014 11:41 PM
To: Discussions about RabbitMQ
Subject: Re: [rabbitmq-discuss] Multiple shovels to increase create a LB queue?

On 14 Jan 2014, at 10:30, Michael Giagnocavo <mgg at giagnocavo.net> wrote:

> Our plan is to make multiple central RabbitMQ servers, and each one will run Shovel and pull from those producing RabbitMQ instances. The idea is that since consumers get load balanced, we can scale horizontally in a nearly "unlimited" fashion just by adding new "central" servers, each shoveling from each producer. And it just requires our consumers to connect to multiple queues, which is no big deal. And each server can run a mirrored queue giving us HA, and if any central server fails, only a part of the capacity is affected.
>  
> Is this a sound approach? Or is there some simpler way?

I'd recommend taking a look at federated queues:
http://www.rabbitmq.com/federated-queues.html

MK

Software Engineer, Pivotal/RabbitMQ

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss at lists.rabbitmq.com
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss