[rabbitmq-discuss] RabbitMQ using a ton of memory

Wed Sep 7 23:07:29 BST 2011

Hi Justin,

I'm sure you are, but could you just confirm that your clients are
acking msgs that they're sent - it's not some issue with messages not
being acknowledged and thus building up on the server?

Matthew

On Wed, Sep 07, 2011 at 02:57:53PM -0700, justin.adam.miller at gmail.com wrote:
> I have a fast producer and about 30 consumers handling the incoming
> messages. My queue length stays near zero as do the number of
> unacknowledged messages as reported by rabbitmqctl. In other words, my
> consumers are able to handle the rate and are definitely acking
> messages.
> 
> I'm running rabbit on a machine with 96GB of RAM and I've set the high
> watermark to 0.7.
> 
> I can run like this for several hours, all the while watching memory
> usage vacillate as erlang garbage collects. These are never monumental
> GC's though. It never drops from, say, 30 GB of memory down to 5GB.
> It's usually within a few GB. Problem is though, the memory usage
> creeps up over that time until we hit the high watermark and then, as
> expected, everything stops.
> 
> I understand the memory flow control issues and why my producers stop
> when that high watermark is hit, but I don't understand why, if I'm
> keeping all my queues pretty empty, my memory usage keeps creeping up?
> 
> Any thoughts?
> 
> Thanks,
> Justin
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss