[rabbitmq-discuss] Rabbit Mq 3.0.2 memory leak

Fri Dec 27 16:55:55 GMT 2013

Hello there,

     I am facing a memory leak situation with our production cluster with
Rabbit version 3.0.2. We have one high volume queue (out of other 45
queues) causing this issue. The cluster has 2 nodes and the memory leak
happens only on the slave node for that queue. I am attaching two
screenshots to show

   1. memory on the slave builds up over time compared to the master which
   stays consistently around 400 MB.
   2. memory doubles every few seconds for the slave node.

Original memory usage ( which is so high compared to the second node which
is the master for that queue)
[image: Inline image 2]
Doubled memory on slave
[image: Inline image 3]
This queue processes 300-350 messages a sec and we have around 0 to 20
messages in the queue coz of traffic spikiness. Here is how producers and
consumers are using it.

Producers:
    Application (php, web servers) will establish a connection, publish a
message, close the connection. We have approx 250 app servers publishing
messages for this queue.

Consumers:
    Worker will establish a connection, consume messages using get with
autoack for 2 mins, worker will close the connection and dies. 448 workers
are consuming messages for this queue.

Note: we use php amqplib 0.2.2 (which is really old and due for an upgrade)

I know the quick answer is "upgrade" but is there a short term solution to
fix this before we upgrade? I usually delete the queue (since application
creates it if it doesn't exist) and take it to stable state before the
memory builds up for 3 days to hit the watermark.

Thanks,
Shri
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20131227/725a1323/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: SlaveMemoryOriginal.png
Type: image/png
Size: 53360 bytes
Desc: not available
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20131227/725a1323/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: SlaveMemory.png
Type: image/png
Size: 51949 bytes
Desc: not available
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20131227/725a1323/attachment-0001.png>