<div><font class="Apple-style-span" face="arial, helvetica, sans-serif">Matthias,</font></div><div><font class="Apple-style-span" face="arial, helvetica, sans-serif"><br></font></div><div><font class="Apple-style-span" face="arial, helvetica, sans-serif">Here you go:</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;"><div>=INFO REPORT==== 26-Jan-2010::17:56:57 ===</div><div>Memory limit set to 817MB.</div>
<div>=INFO REPORT==== 26-Jan-2010::17:56:57 ===</div><div>disk_log: repairing "c:/AMQP/RabbitMQ/rabbitmq_server-1.7.1/db/BIGPOOH-mnesia/ra</div><div>bbit_persister.LOG" ...</div><div>=INFO REPORT==== 26-Jan-2010::17:56:57 ===</div>
<div>Repaired persister log - 1 recovered, 0 bad</div><div>=INFO REPORT==== 26-Jan-2010::17:56:57 ===</div><div>Rolling persister log to "c:/AMQP/RabbitMQ/rabbitmq_server-1.7.1/db/BIGPOOH-mnes</div><div>ia/rabbit_persister.LOG.previous"</div>
<div>=INFO REPORT==== 26-Jan-2010::17:56:57 ===</div><div>started TCP Listener on <a href="http://0.0.0.0:5672">0.0.0.0:5672</a></div><div>=INFO REPORT==== 26-Jan-2010::17:57:07 ===</div><div>accepted TCP connection on <a href="http://0.0.0.0:5672">0.0.0.0:5672</a> from <a href="http://127.0.0.1:39913">127.0.0.1:39913</a></div>
<div>=INFO REPORT==== 26-Jan-2010::17:57:07 ===</div><div>starting TCP connection <0.150.0> from <a href="http://127.0.0.1:39913">127.0.0.1:39913</a></div><div>=INFO REPORT==== 26-Jan-2010::17:57:07 ===</div><div>accepted TCP connection on <a href="http://0.0.0.0:5672">0.0.0.0:5672</a> from <a href="http://127.0.0.1:39914">127.0.0.1:39914</a></div>
<div>=INFO REPORT==== 26-Jan-2010::17:57:07 ===</div><div>starting TCP connection <0.156.0> from <a href="http://127.0.0.1:39914">127.0.0.1:39914</a></div><div>=INFO REPORT==== 26-Jan-2010::17:57:51 ===</div><div>vm_memory_high_watermark set. Memory used:1002985248 allowed:856947097</div>
<div>=INFO REPORT==== 26-Jan-2010::17:57:51 ===</div><div> alarm_handler: {set,{vm_memory_high_watermark,[]}}</div><div>=INFO REPORT==== 26-Jan-2010::17:57:52 ===</div><div>vm_memory_high_watermark clear. Memory used:684715512 allowed:856947097</div>
<div>=INFO REPORT==== 26-Jan-2010::17:57:52 ===</div><div> alarm_handler: {clear,vm_memory_high_watermark}</div><div>=INFO REPORT==== 26-Jan-2010::17:58:04 ===</div><div>vm_memory_high_watermark set. Memory used:1066534848 allowed:856947097</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:04 ===</div><div> alarm_handler: {set,{vm_memory_high_watermark,[]}}</div><div>=INFO REPORT==== 26-Jan-2010::17:58:05 ===</div><div>vm_memory_high_watermark clear. Memory used:772812808 allowed:856947097</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:05 ===</div><div> alarm_handler: {clear,vm_memory_high_watermark}</div><div>=INFO REPORT==== 26-Jan-2010::17:58:06 ===</div><div>vm_memory_high_watermark set. Memory used:1264119968 allowed:856947097</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:06 ===</div><div> alarm_handler: {set,{vm_memory_high_watermark,[]}}</div><div>=INFO REPORT==== 26-Jan-2010::17:58:08 ===</div><div>vm_memory_high_watermark clear. Memory used:739226624 allowed:856947097</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:08 ===</div></span></font></div><div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small; "><div> alarm_handler: {clear,vm_memory_high_watermark}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:11 ===</div><div>vm_memory_high_watermark set. Memory used:890590656 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:11 ===</div><div> alarm_handler: {set,{vm_memory_high_watermark,[]}}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:13 ===</div><div>vm_memory_high_watermark clear. Memory used:766122704 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:13 ===</div><div> alarm_handler: {clear,vm_memory_high_watermark}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:14 ===</div><div>vm_memory_high_watermark set. Memory used:890671408 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:14 ===</div><div> alarm_handler: {set,{vm_memory_high_watermark,[]}}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:17 ===</div><div>vm_memory_high_watermark clear. Memory used:776145328 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:17 ===</div><div> alarm_handler: {clear,vm_memory_high_watermark}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:18 ===</div><div>vm_memory_high_watermark set. Memory used:1300245088 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:18 ===</div><div> alarm_handler: {set,{vm_memory_high_watermark,[]}}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:21 ===</div><div>vm_memory_high_watermark clear. Memory used:784244032 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:21 ===</div><div> alarm_handler: {clear,vm_memory_high_watermark}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:22 ===</div><div>vm_memory_high_watermark set. Memory used:902589440 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:22 ===</div><div> alarm_handler: {set,{vm_memory_high_watermark,[]}}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:27 ===</div><div>vm_memory_high_watermark clear. Memory used:791158912 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:27 ===</div><div> alarm_handler: {clear,vm_memory_high_watermark}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:28 ===</div><div>vm_memory_high_watermark set. Memory used:918087056 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:28 ===</div><div> alarm_handler: {set,{vm_memory_high_watermark,[]}}</div>
<div>=INFO REPORT==== 26-Jan-2010::17:58:34 ===</div><div>vm_memory_high_watermark clear. Memory used:800483800 allowed:856947097</div><div>=INFO REPORT==== 26-Jan-2010::17:58:34 ===</div><div><br></div><div> alarm_handler: {clear,vm_memory_high_watermark}</div>
</span></font></div>The above log is from a run with 0.2 memory on a 4GB machine running Windows 7 X64. This is the first time I have seen the messages about memory high watermark.<div><br><div>The attached image is a screen shot from the task manager showing the Erl statistics right when it crashed using memory of .02. Not sure if it helps, but hope so...<br>
<div><br></div><div>The following log is from a run with memory set to 0.3:</div><div><div><span class="Apple-style-span" style="font-size: x-small;"><font class="Apple-style-span" face="'courier new', monospace">=INFO REPORT==== 26-Jan-2010::18:15:09 ===</font></span></div>
<div><span class="Apple-style-span" style="font-size: x-small;"><font class="Apple-style-span" face="'courier new', monospace">Memory limit set to 1225MB.</font></span></div><div><span class="Apple-style-span" style="font-family: 'courier new', monospace; font-size: x-small; ">=INFO REPORT==== 26-Jan-2010::18:15:09 ===</span></div>
<div><span class="Apple-style-span" style="font-size: x-small;"><font class="Apple-style-span" face="'courier new', monospace">disk_log: repairing "c:/AMQP/RabbitMQ/rabbitmq_server-1.7.1/db/BIGPOOH-mnesia/ra</font></span></div>
<div><span class="Apple-style-span" style="font-size: x-small;"><font class="Apple-style-span" face="'courier new', monospace">bbit_persister.LOG" ...</font></span></div><div><span class="Apple-style-span" style="font-family: 'courier new', monospace; font-size: x-small; ">=INFO REPORT==== 26-Jan-2010::18:15:09 ===</span></div>
<div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;">Repaired persister log - 1 recovered, 0 bad</span></font></div><div><span class="Apple-style-span" style="font-family: 'courier new', monospace; font-size: x-small; ">=INFO REPORT==== 26-Jan-2010::18:15:09 ===</span></div>
<div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;">Rolling persister log to "c:/AMQP/RabbitMQ/rabbitmq_server-1.7.1/db/BIGPOOH-mnes</span></font></div>
<div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;">ia/rabbit_persister.LOG.previous"</span></font></div><div><span class="Apple-style-span" style="font-family: 'courier new', monospace; font-size: x-small; ">=INFO REPORT==== 26-Jan-2010::18:15:10 ===</span></div>
<div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;">started TCP Listener on <a href="http://0.0.0.0:5672">0.0.0.0:5672</a></span></font></div>
<div><span class="Apple-style-span" style="font-family: 'courier new', monospace; font-size: x-small; ">=INFO REPORT==== 26-Jan-2010::18:15:13 ===</span></div><div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;">accepted TCP connection on <a href="http://0.0.0.0:5672">0.0.0.0:5672</a> from <a href="http://127.0.0.1:40341">127.0.0.1:40341</a></span></font></div>
<div><span class="Apple-style-span" style="font-family: 'courier new', monospace; font-size: x-small; ">=INFO REPORT==== 26-Jan-2010::18:15:13 ===</span></div><div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;">starting TCP connection <0.143.0> from <a href="http://127.0.0.1:40341">127.0.0.1:40341</a></span></font></div>
<div><span class="Apple-style-span" style="font-family: 'courier new', monospace; font-size: x-small; ">=INFO REPORT==== 26-Jan-2010::18:15:13 ===</span></div><div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;">accepted TCP connection on <a href="http://0.0.0.0:5672">0.0.0.0:5672</a> from <a href="http://127.0.0.1:40342">127.0.0.1:40342</a></span></font></div>
<div><span class="Apple-style-span" style="font-family: 'courier new', monospace; font-size: x-small; ">INFO REPORT==== 26-Jan-2010::18:15:13 ===</span></div><div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;">starting TCP connection <0.149.0> from <a href="http://127.0.0.1:40342">127.0.0.1:40342</a></span></font></div>
<div><span class="Apple-style-span" style="font-family: arial, helvetica, sans-serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: arial, helvetica, sans-serif; ">Last test was to run with 0.1 memory. This did not get very far and is now hanging. The client managed only a few exchanges:</span></div>
<div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;"><br></span></font></div><div><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;"><div>
here we go at 18:23:03.19 2010-01-26</div><div>starting consumer #0</div><div>starting producer #0</div><div>sending rate: 11398 msg/s</div><div>sending rate: 10602 msg/s</div><div>sending rate: 6831 msg/s</div><div>sending rate: 2148 msg/s</div>
<div><font class="Apple-style-span" face="arial, helvetica, sans-serif"><span class="Apple-style-span" style="font-size: small;"><font class="Apple-style-span" face="'courier new', monospace"><span class="Apple-style-span" style="font-size: x-small;"><br>
</span></font></span></font></div></span></font></div><div><font class="Apple-style-span" face="'courier new', monospace">The rabbit.log for the 0.1 memory run is attached.</font></div><div><font class="Apple-style-span" face="'courier new', monospace"><br>
</font></div><div><font class="Apple-style-span" face="'courier new', monospace">Cheers, John</font></div><div class="gmail_quote">On Tue, Jan 26, 2010 at 16:38, Matthias Radestock <span dir="ltr"><<a href="mailto:matthias@lshift.net">matthias@lshift.net</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">John,<div class="im"><br>
<br>
John Apps wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
This is rabbit.log after starting the server:<br>
=INFO REPORT==== 26-Jan-2010::16:09:34 ===<br>
Memory limit set to 1634MB.<br>
</blockquote>
<br></div>
Does that figure seem reasonable? How much physical memory and swap do you have? And do you have other processes running that could be eating into that?<br>
<br>
Basically, you need to make sure that the above figure is well below (<40%) the amount of memory the rabbit process can safely ask for from the O/S.<div class="im"><br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
=INFO REPORT==== 26-Jan-2010::16:09:34 ===<br>
Rolling persister log to "c:/AMQP/RabbitMQ/rabbitmq_server-1.7.0/db/rabbit-mnesi<br>
a/rabbit_persister.LOG.previous"<br>
=INFO REPORT==== 26-Jan-2010::16:09:35 ===<br>
started TCP Listener on <a href="http://0.0.0.0:5672" target="_blank">0.0.0.0:5672</a><br>
</blockquote>
<br></div>
Have you got the rest of that log file?<br>
<br>
<br>
Regards,<br><font color="#888888">
<br>
Matthias.<br></font>
PS: no need to attach further crash dumps.<br>
</blockquote></div><br><br clear="all"><br>-- <br>---<br>John Apps<br>(49) 171 869 1813<br>Sent from Traunstein, Bavaria, Germany
</div></div></div>