[rabbitmq-discuss] Rabbitmq consumer grouping

Thu Oct 11 16:47:43 BST 2012

+list

On Thu, Oct 11, 2012 at 8:46 AM, kishore g <g.kishore at gmail.com> wrote:
> Thanks Matthias,
>
> I was not aware of consumer load balancing feature, does it assign
> each queue to one consumer or any consumers will consume from any
> queue. I was talking about a case where the queues(partitions) are
> divided among the consumers. Lets say the consumers want to do some
> aggregation on a key, then it would be better if all messages for a
> given key go to one consumer. Does it make sense?
>
> Thanks,
> Kishore G
>
> On Thu, Oct 11, 2012 at 12:49 AM, Matthias Radestock
> <matthias at rabbitmq.com> wrote:
>> Kishore,
>>
>>
>> On 10/10/12 19:38, kishore g wrote:
>>>
>>> I am writing this email to get feedback about a rabbitmq consumer
>>> group. We developed this recipe using Helix, a generic cluster
>>> management system which we open sourced yesterday. In order to
>>> demonstrate the ease of developing applications with Helix, we chose
>>> to write a rabbitmq-consumer-group.
>>>
>>> You can find more info about that here
>>>
>>> https://github.com/linkedin/helix/wiki/Sample_App
>>>
>>> It would be great if you can provide feedback about this app.
>>
>>
>> That looks pretty interesting.
>>
>> One question: wouldn't you get the same failure-handling and scaling
>> behaviour by having all consumers consume from all queues? RabbitMQ's own
>> consumer load balancing should ensure that messages are distributed fairly
>> to consumers in such a set up.
>>
>> Regards,
>>
>> Matthias.