[rabbitmq-discuss] best practices for managing multiple consumer instances

Jason J. W. Williams jasonjwwilliams at gmail.com
Sat Jun 19 01:04:09 BST 2010


You used to be able to check queue depth by re-declaring the queue...a
la this Nagios check we wrote: http://gist.github.com/444401

Reading through the semantic changes in 1.8.0 it may not work going forward.

-J

On Fri, Jun 18, 2010 at 2:48 PM, Shane <shane at digitalsanctum.com> wrote:
> Sure. There are several "jobs" which vary a lot in terms of time to
> complete and complexity. Traditionally, these jobs have always run
> with a fixed priority and number of "consumers" running in one big
> continuous loop. By moving these jobs to RabbitMQ, I hope to be able
> to better tune the jobs by varying priorities and the number
> consumers.
>
> I've already begun to experiment with this by introducing a heartbeat
> exchange which does nothing other than logging the number of messages
> and consumers on a queue.
>
> As you've indicated there seems like several ways to go about this,
> which is why I asked if there were any best practices or patterns.
>
> Thanks again.
>
>
> On Jun 18, 3:29 pm, Alexis Richardson <ale... at rabbitmq.com> wrote:
>> Shane
>>
>> I see, thanks.
>>
>> The best way to do this is outside of RabbitMQ, by monitoring
>> consumers and their work, out of band..  It's not something where
>> there is 'one way to do it'.
>>
>> Can you tell us more about your use case please?
>>
>> alexis
>>
>>
>>
>>
>>
>> On Fri, Jun 18, 2010 at 8:14 PM, Shane <sh... at digitalsanctum.com> wrote:
>> > I mean being able to tune the number of consumers and their behavior
>> > on multiple machines. For example, being able to view the performance
>> > of queues and being able to start more consumers or stop consumers
>> > gracefully.
>>
>> > On Jun 18, 11:13 am, Alexis Richardson <ale... at rabbitmq.com> wrote:
>> >> Shane
>>
>> >> On Thu, Jun 17, 2010 at 6:33 PM, Shane <sh... at digitalsanctum.com> wrote:
>> >> > Anyone have any suggestions on how best to best to manage multiple
>> >> > consumers instances?
>>
>> >> What do you mean?
>>
>> >> alexis
>> >> _______________________________________________
>> >> rabbitmq-discuss mailing list
>> >> rabbitmq-disc... at lists.rabbitmq.comhttp://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>> > _______________________________________________
>> > rabbitmq-discuss mailing list
>> > rabbitmq-disc... at lists.rabbitmq.com
>> >http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>>
>> _______________________________________________
>> rabbitmq-discuss mailing list
>> rabbitmq-disc... at lists.rabbitmq.comhttp://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>


More information about the rabbitmq-discuss mailing list