[rabbitmq-discuss] RabbitMQ - can we make use policies as load balancing in cluster?

Fri Oct 18 07:57:17 BST 2013

On oct 18, 2013, at 9:09 a.m., Rajasekhar P <sekhar434145 at gmail.com> wrote:

> What we are trying to achieve to distribute specific queues/message to particular node, like - 
> 
> queue1, messages 1-100 goes to node1,
> queue1, messages 101-200 goes to node2,
> queue2, messages 201-300 goes to node3,
> queue2, messages 301-400 goes to node4, etc.
> 
> 
> Is this can be achieved using policies?

You're still not specifying if you are using federation or mirrored queues.

Mirrored queues cannot do that. Mirroring is about copying
messages to 2+ nodes.

Sharded queues is a feature that's being discussed, in the meantime,
federated queues in 3.2 is the closest to load balancing a single queue you can get.

Also, you can partition a message stream between queues using consistent hashing
exchange [1] and techniques such as [2].

1. https://github.com/rabbitmq/rabbitmq-consistent-hash-exchange
2. http://about.travis-ci.org/blog/2013-08-08-solving-the-puzzle-of-scalable-log-processing/

MK

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 495 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20131018/1590b56e/attachment.pgp>