[rabbitmq-discuss] Bound Queues

[Colin Clark]

Are you not able to add more consumers?

On 5/12/2010 11:47 AM, srw wrote:
>
> Tony Garnock-Jones-2 wrote:
>    
>> Dan Di Spaltro wrote:
>>      
>>> Is there anyway you can specify a memory/disk/length limit to a queue
>>> size with the action being a similar to a fixed window?
>>>        
>> Not at the moment, no.
>>
>>      
>>> If not, is there any chance it is on the roadmap?  I know its not in
>>> the amqp spec, but it could be treated like a header.
>>>        
>> It's not exactly on the roadmap
>> ...
>> ...
>> ...
>>
>>      
> As a RabbitMQ newbie I was thinking on this issue too: is it possible to
> block publisher's send while the queue is above a certain threshold?
>
> I am experiencing many RabbitMQ crashes because the queue size surpass the
> machine memory. This is happening in many scenarios where the ratio between
> #published_messages/#consumed_messages is very high (and the message size is
> big). Don't know if it's very uncommon. My use case is a long text mining
> pipeline where there is a lot of input data and some processes cause a
> bottleneck (but with the solution exposed above the bottleneck will just
> slow the publishers and every process will finish).
>
> Thanks,
> srw
>
>    
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20100512/643a64a9/attachment.htm