[rabbitmq-discuss] Shovel questions

Sun Jan 22 12:46:15 GMT 2012

On Sat, Jan 21, 2012 at 23:58, Elias Levy <fearsome.lucidity at gmail.com>wrote:

> We are thinking of exposing a portion of our message bus to customers.  To
> do we we will be creating a new cluster that can be exposed and will be
> linking it to our existing cluster.
>
> I've looked a the Federation plug-in, but it has a feature disqualifies it
> for our purposes.   We'd like to keep communications from our existing
> cluster to the new exposed cluster unidirectional.  That means now allowing
> incoming connections into the existing cluster, in case there is ever a
> RabbitMQ vulnerability (or say, an Erlang or OpenSSL vulnerability) that
> would allow the external cluster to be compromised.  Since both cluster are
> running RabbitMQ, we don't want an attacker to be able to jump from the
> external cluster to the internal one.  From what I've gathered, the AMQP
> client that the Federation plug-in uses executed within the downstream
> broker, and thus it has to be able to make an AMQP connection to the
> upstream broker.
>
> Is that correct?  Any plans to allow for the opposite behavior (upstream
> connects to the downstream broker)?
>

I don't know the internals of the federation plugin well enough to be able
to answer this question. I know that it uses exchange-exchange bindings and
I'm not sure if it's even feasible to have it work in the way you describe.

>
> That leaves us with the Shovel plug-in, which can be configured to run on
> either the upstream or downstream broker.
>
> One problem with the Shovel plug-in is that it appears you can only manage
> the shovels within the configuration file.  Is there no way to manage
> shovels online, either through AMQP or a management plug-in?
>

No, there is no way to do that except in the configuration file.

>
> If neither of those are possible, can RabbitMQ reload its configuration
> without restarting?
>

No, you cannot do that. Nonetheless be aware that shovel is not hard to set
up manually as an external component from the broker, although with some
gotchas. We've been doing that for some time before the federation plugin
was published.

>
> Finally, its unclear whether you should only define a shovel in a single
> node in a cluster or in multiple ones?  If you define it in multiple ones,
> does it create multiple shovel clients competing for messages?  If not,
> will a shovel fail over if the node with the existing client fails?
>

Shovel is a low level mechanis, so whatever you configure it, it will do
what you told it to, i.e. pick messages from one queue and publish them to
some exchange. How you set it up is then up to you according to what you
want to accomplish.

>
> Elias
>
>
>
>
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20120122/7b6da4b9/attachment.htm>