[rabbitmq-discuss] Queue increases too quickly

Thu May 2 10:00:20 BST 2013

Hi,

On 2 May 2013, at 09:52, Ken Peng wrote:

> Hello,
> 
> We have the queue publisher and subscriber, the subscriber is going with multi-threads.
> 
> The problem is the queue has been increasing too quickly, the consumers can not follow the increment speed, as you see:
[snip]
> After one day or about, the queue size can be more than 20 millions, thus RabbitMQ becomes high load and the consuming process is very slow.
> 
> How to handle this? Thanks.
> ___

You'll need to consume faster. :)

Maybe using a prefetch count to take a block of messages in each consumer and would help a bit, although they're not going to actually 'disappear' from rabbit until they've been ACKed.