[rabbitmq-discuss] High binary memory usage?

Thu Jul 18 21:42:44 BST 2013

Hi,

Our RabbitMQ server has now been running for 2-3 days and this morning we
noticed it has gone above the high memory watermark of 1.6 GB. I ran
'rabbitmqctl status' to understand the memory usage, as there were no
messages queued. Here is the result:

[{pid,4504},

{running_applications,

     [{rabbitmq_management,"RabbitMQ Management Console","3.0.2"},

      {rabbitmq_management_agent,"RabbitMQ Management Agent","3.0.2"},

      {rabbit,"RabbitMQ","3.0.2"},

      {ssl,"Erlang/OTP SSL application","5.1.2"},

      {public_key,"Public key infrastructure","0.17"},

      {crypto,"CRYPTO version 2","2.2"},

      {os_mon,"CPO  CXC 138 46","2.2.10"},

      {rabbitmq_mochiweb,"RabbitMQ Mochiweb Embedding","3.0.2"},

      {webmachine,"webmachine","1.9.1-rmq3.0.2-git52e62bc"},

      {mochiweb,"MochiMedia Web Server","2.3.1-rmq3.0.2-gitd541e9a"},

      {xmerl,"XML parser","1.3.2"},

      {inets,"INETS  CXC 138 49","5.9.2"},

      {mnesia,"MNESIA  CXC 138 12","4.7.1"},

      {amqp_client,"RabbitMQ AMQP Client","0.0.0"},

      {sasl,"SASL  CXC 138 11","2.2.1"},

      {stdlib,"ERTS  CXC 138 10","1.18.3"},

      {kernel,"ERTS  CXC 138 10","2.15.3"}]},

{os,{unix,linux}},

{erlang_version,

     "Erlang R15B03 (erts-5.9.3.1) [source] [smp:8:8] [async-threads:30]
[hipe] [kernel-poll:true]\n"},

{memory,

     [{total,1806492128},

      {connection_procs,463497352},

      {queue_procs,47298896},

      {plugins,810880},

      {other_proc,0},

      {mnesia,4795268},

      {mgmt_db,56057116},

      {msg_index,3831448},

      {other_ets,12874188},

      {binary,1165034312},

      {code,10672981},

      {atom,1606805},

      {other_system,47749138}]},

{vm_memory_high_watermark,0.4},

{vm_memory_limit,1717986918},

{disk_free_limit,1000000000},

{disk_free,23417651200},

{file_descriptors,

     [{total_limit,15900},

      {total_used,14923},

      {sockets_limit,14308},

      {sockets_used,14308}]},

{processes,[{limit,1048576},{used,134052}]},

{run_queue,0},

{uptime,679042}]

...done.

So, these two turn out to be the culprits:

{connection_procs,463497352},

{binary,1165034312}

Now, connections_procs is somewhat understandable, because there are a
high number of connections. But, I cannot understand why the binary memory
usage is so high. Can you please explain? How to keep this in check?

Thanks

Kapil

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130718/51196971/attachment.htm>