[rabbitmq-discuss] Rabbitmq consumer grouping

kishore g g.kishore at gmail.com
Thu Oct 11 16:47:43 BST 2012


On Thu, Oct 11, 2012 at 8:46 AM, kishore g <g.kishore at gmail.com> wrote:
> Thanks Matthias,
> I was not aware of consumer load balancing feature, does it assign
> each queue to one consumer or any consumers will consume from any
> queue. I was talking about a case where the queues(partitions) are
> divided among the consumers. Lets say the consumers want to do some
> aggregation on a key, then it would be better if all messages for a
> given key go to one consumer. Does it make sense?
> Thanks,
> Kishore G
> On Thu, Oct 11, 2012 at 12:49 AM, Matthias Radestock
> <matthias at rabbitmq.com> wrote:
>> Kishore,
>> On 10/10/12 19:38, kishore g wrote:
>>> I am writing this email to get feedback about a rabbitmq consumer
>>> group. We developed this recipe using Helix, a generic cluster
>>> management system which we open sourced yesterday. In order to
>>> demonstrate the ease of developing applications with Helix, we chose
>>> to write a rabbitmq-consumer-group.
>>> You can find more info about that here
>>> https://github.com/linkedin/helix/wiki/Sample_App
>>> It would be great if you can provide feedback about this app.
>> That looks pretty interesting.
>> One question: wouldn't you get the same failure-handling and scaling
>> behaviour by having all consumers consume from all queues? RabbitMQ's own
>> consumer load balancing should ensure that messages are distributed fairly
>> to consumers in such a set up.
>> Regards,
>> Matthias.

More information about the rabbitmq-discuss mailing list