[rabbitmq-discuss] basic.qos prefetch across multiple queues - useful?

Laing, Michael P. Michael.Laing at nytimes.com
Mon Mar 18 19:00:53 GMT 2013


We use python - a process normally has several channels open, using pika.SelectConnection and the continuation (event-driven) programming style.

However, we typically use a channel per queue partly so that we can set prefetch on a per queue basis.

So I think it would make more sense for the prefetch limit to be associated directly with the queue.

Michael

From: Alvaro Videla <videlalvaro at gmail.com<mailto:videlalvaro at gmail.com>>
Reply-To: rabbitmq <rabbitmq-discuss at lists.rabbitmq.com<mailto:rabbitmq-discuss at lists.rabbitmq.com>>
Date: Monday, March 18, 2013 1:36 PM
To: rabbitmq <rabbitmq-discuss at lists.rabbitmq.com<mailto:rabbitmq-discuss at lists.rabbitmq.com>>
Subject: Re: [rabbitmq-discuss] basic.qos prefetch across multiple queues - useful?

Hi,

I think per-queue would be better, at least for the PHP people. Since PHP doesn't support threads is not common to have multiple channels in one process. So basic.qos as is today limits every queue in the channel for most PHP scripts.

I guess other languages like Python are in the same area.

Regards,

Alvaro


On Mon, Mar 18, 2013 at 7:30 PM, Matthias Radestock <matthias at rabbitmq.com<mailto:matthias at rabbitmq.com>> wrote:
Is anybody setting a basic.qos prefetch limit on channels with consumers on multiple queues?

If so, are you relying on the fact that the prefetch limit applies *across* queues rather than *per* queue?

That feature entails considerable implementation complexity and has a substantial performance impact on consuming from basic.qos-limited channels in general. And I've just found a bug in that area of the code, fixing of which will make the implementation even more complex and hurt performance even more.

Hence I am trying to gauge people's opinion on whether we could make the prefetch limit apply per-queue instead.

Regards,

Matthias.
_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss at lists.rabbitmq.com<mailto:rabbitmq-discuss at lists.rabbitmq.com>
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130318/e70e95ff/attachment.htm>


More information about the rabbitmq-discuss mailing list