[rabbitmq-discuss] Exchange to Queue load distribution in round-robin manner

Thu Nov 15 08:43:46 GMT 2012

2012/11/15 Kaushal Panjwani <kaushal.panjwani at gmail.com>

> Using a single worker queue seems to do the job, but the volumes we are
> looking at is approximately 10,000 msg/sec. So my question is if there are
> any limit on the capacity of single worker queue?

There is and 10,000 msg/s is probably beyond what a single queue can handle
on the kind of hardware you get from Heroku
add-ons.

> And are there any other solution available out of the box for the load
> distribution which scales automatically with scaling out of workers?

Consistent hashing exchange does what you want but it is not built-in. So
to use it, you will likely have to host
RabbitMQ on your own:

https://github.com/rabbitmq/rabbitmq-consistent-hash-exchange

That said, with message volumes of that magnitude I suspect that
self-hosting will be necessary for other reasons anyway.

HTH,
-- 
MK

http://github.com/michaelklishin
http://twitter.com/michaelklishin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20121115/3a1e2742/attachment.htm>