[rabbitmq-discuss] rabbitmq-server dies from out of memory

[François Beausoleil]

I changed overcommit_memory from 2 to 0, and RabbitMQ stays up for more 
than 15 seconds now. That seems to have been my error.

Thanks!
François

On Tuesday, October 29, 2013 5:10:13 PM UTC-4, François Beausoleil wrote:
>
> Hi all!
>
> I have a bare metal server with 32 GiB of RAM. I installed RabbitMQ 3.2.0, 
> Erlang R16B02.
>
> When load increases (publishing over 4000 msgs/s), RabbitMQ dies with 
> "Could not allocate memory" errors:
>
> Crash dump was written to: erl_crash.dump
> eheap_alloc: Cannot allocate 529782288 bytes of memory (of type "heap").
>
> The messages which are published are about 4 KiB of XML. The persistent 
> option is set to true, to ensure persistence across reboots.
>
> The host has configuration for overcommit:
>
> # cat /proc/sys/vm/overcommit_ratio
> 50
> # cat /proc/sys/vm/overcommit_memory
> 2
>
> On start, RabbitMQ correctly identifies the total amount of memory:
>
> =INFO REPORT==== 29-Oct-2013::20:58:03 ===
> node           : rabbit at skyler
> home dir       : /var/lib/rabbitmq
> config file(s) : (none)
> cookie hash    : mV5+4OI0hTEXkDPMtOzVdQ==
> log            : /var/log/rabbitmq/rabbit at skyler.log
> sasl log       : /var/log/rabbitmq/rabbit at skyler-sasl.log
> database dir   : /var/lib/rabbitmq/mnesia/rabbit at skyler
>
> =INFO REPORT==== 29-Oct-2013::20:58:04 ===
> Limiting to approx 3996 file handles (3594 sockets)
>
> =INFO REPORT==== 29-Oct-2013::20:58:04 ===
> Memory limit set to 12826MB of 32066MB total.
>
> =INFO REPORT==== 29-Oct-2013::20:58:04 ===
> Disk free limit set to 50MB
>
> On the same host, I'm also running a Java application. The Java 
> application's max heap is set to 6 GiB, through -Xmx6g.
>
> Google and StackOverflow aren't very helpful: there are a few mentions, 
> but not many apply to RabbitMQ, and the other ones don't seem to apply or 
> are very old.
>
> What can I do to troubleshoot the problem?
>
> Thanks!
> François
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20131031/1ec1d32d/attachment.htm>