[rabbitmq-discuss] RabbitMQ using a ton of memory
justin.adam.miller at gmail.com
justin.adam.miller at gmail.com
Thu Sep 8 12:47:27 BST 2011
Not that this is exactly your purview, but I'm using Spring AMQP RC2,
with acknowledgeMode set to AUTO which, in Spring AMQP terms, means
the container will ack every message.
Also, is there any other way to check that messages are being acked,
besides checking 'rabbitmqctl messages_unacknowledged"? That number
definitely returns 0 (or close to it) at all times.
On Sep 7, 6:07 pm, Matthew Sackman <matt... at rabbitmq.com> wrote:
> Hi Justin,
>
> I'm sure you are, but could you just confirm that your clients are
> acking msgs that they're sent - it's not some issue with messages not
> being acknowledged and thus building up on the server?
>
> Matthew
>
>
>
>
>
>
>
>
>
> On Wed, Sep 07, 2011 at 02:57:53PM -0700, justin.adam.mil... at gmail.com wrote:
> > I have a fast producer and about 30 consumers handling the incoming
> > messages. My queue length stays near zero as do the number of
> > unacknowledged messages as reported by rabbitmqctl. In other words, my
> > consumers are able to handle the rate and are definitely acking
> > messages.
>
> > I'm running rabbit on a machine with 96GB of RAM and I've set the high
> > watermark to 0.7.
>
> > I can run like this for several hours, all the while watching memory
> > usage vacillate as erlang garbage collects. These are never monumental
> > GC's though. It never drops from, say, 30 GB of memory down to 5GB.
> > It's usually within a few GB. Problem is though, the memory usage
> > creeps up over that time until we hit the high watermark and then, as
> > expected, everything stops.
>
> > I understand the memory flow control issues and why my producers stop
> > when that high watermark is hit, but I don't understand why, if I'm
> > keeping all my queues pretty empty, my memory usage keeps creeping up?
>
> > Any thoughts?
>
> > Thanks,
> > Justin
> > _______________________________________________
> > rabbitmq-discuss mailing list
> > rabbitmq-disc... at lists.rabbitmq.com
> >https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-disc... at lists.rabbitmq.comhttps://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
More information about the rabbitmq-discuss
mailing list