[rabbitmq-discuss] Queue increases too quickly
tim at rabbitmq.com
Thu May 2 10:00:20 BST 2013
On 2 May 2013, at 09:52, Ken Peng wrote:
> We have the queue publisher and subscriber, the subscriber is going with multi-threads.
> The problem is the queue has been increasing too quickly, the consumers can not follow the increment speed, as you see:
> After one day or about, the queue size can be more than 20 millions, thus RabbitMQ becomes high load and the consuming process is very slow.
> How to handle this? Thanks.
You'll need to consume faster. :)
Maybe using a prefetch count to take a block of messages in each consumer and would help a bit, although they're not going to actually 'disappear' from rabbit until they've been ACKed.
More information about the rabbitmq-discuss