[rabbitmq-discuss] best practices for managing multiple consumer instances

Fri Jun 18 21:48:31 BST 2010

Sure. There are several "jobs" which vary a lot in terms of time to
complete and complexity. Traditionally, these jobs have always run
with a fixed priority and number of "consumers" running in one big
continuous loop. By moving these jobs to RabbitMQ, I hope to be able
to better tune the jobs by varying priorities and the number
consumers.

I've already begun to experiment with this by introducing a heartbeat
exchange which does nothing other than logging the number of messages
and consumers on a queue.

As you've indicated there seems like several ways to go about this,
which is why I asked if there were any best practices or patterns.

Thanks again.

On Jun 18, 3:29 pm, Alexis Richardson <ale... at rabbitmq.com> wrote:
> Shane
>
> I see, thanks.
>
> The best way to do this is outside of RabbitMQ, by monitoring
> consumers and their work, out of band..  It's not something where
> there is 'one way to do it'.
>
> Can you tell us more about your use case please?
>
> alexis
>
>
>
>
>
> On Fri, Jun 18, 2010 at 8:14 PM, Shane <sh... at digitalsanctum.com> wrote:
> > I mean being able to tune the number of consumers and their behavior
> > on multiple machines. For example, being able to view the performance
> > of queues and being able to start more consumers or stop consumers
> > gracefully.
>
> > On Jun 18, 11:13 am, Alexis Richardson <ale... at rabbitmq.com> wrote:
> >> Shane
>
> >> On Thu, Jun 17, 2010 at 6:33 PM, Shane <sh... at digitalsanctum.com> wrote:
> >> > Anyone have any suggestions on how best to best to manage multiple
> >> > consumers instances?
>
> >> What do you mean?
>
> >> alexis
> >> _______________________________________________
> >> rabbitmq-discuss mailing list
> >> rabbitmq-disc... at lists.rabbitmq.comhttp://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
> > _______________________________________________
> > rabbitmq-discuss mailing list
> > rabbitmq-disc... at lists.rabbitmq.com
> >http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-disc... at lists.rabbitmq.comhttp://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss