[rabbitmq-discuss] Queue Failover and restore

[Arun Rao]

Hi Michael -

Thanks for your quick response, as always!

I am already monitoring node column in HTTP API for queues. I get to know
when there is a node failure and I see the queue distribution on nodes as a
pie chart.

After I bring the node back up, I cannot help redistribute queues evenly
again. I am processing several hundred Gigabytes of data per day. CPU Usage
on nodes where queues live and delivery rates are directly related to
number of messages remaining in my queues, that is why I want to
redistribute the queues back again.

(Please note: I have enough consumers to listen on all nodes.)

Please advise if this would make sense to provide an option via rabbitmqctl
or rabbitmqadmin or via management UI?

Thanks for your help!


On Mon, Mar 24, 2014 at 11:52 PM, Michael Klishin <mklishin at gopivotal.com>wrote:

> On 25 March 2014 at 10:49:26, Arun Rao (arunrao.seattle at gmail.com) wrote:
> > > I am under the impression I get more throughput having 16 queues
> > living on 4 different nodes compared to 16 queues living on 3 nodes.
> > This difference becomes noticeable when the number of messages
> > ready picked up are significantly higher? This actually goes
> > back to making queues local and providing more hardware. Am i
> > mistaken?
>
> This is partially true. What matters is publisher and consumer locality.
> For maximum throughput you want to avoid intra-cluster traffic.
>
> In an HA setup, your clients need to reconnect to another node, so likely
> you won't get in a situation when most clients are connected to a single
> node.
>
> If that's not good enough, you can use HTTP API to find what node hosts
> master
> for the queue in question and connect there.
> --
> MK
>
> Software Engineer, Pivotal/RabbitMQ
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20140325/ad8bd609/attachment.html>