<div dir="ltr">Hi Michael,<div><br></div><div><b>Version: </b>I'm running debian linux on a Google Compute Engine instance with RabbitMQ 3.1.3. (more version info below).</div><div><br></div><div><b>Workload:</b> I'm using rabbitmq as part of a process to OCR many PDFs. I add many URLs to various PDFs into rabbitmq. Then, a consumer pulls that link out of rabbitmq, downloads the file, attempts to OCR it, and then sends the result to another server. </div>
<div><br></div><div><b>Diskspace: </b>During OCR, my app writes, reads, and deletes a lot of temporary files, so it is possible that I briefly an out of free disk space momentarily. But I ran df afterwards and it looks like I have enough space. (see below). Even if I did run out of disk space, shouldn't rabbitmq be somewhat graceful about it? Perhaps it should refuse any new jobs while there is no space but then come back online once it detects there is space available.</div>
<div><br></div><div><b>Reproducing: </b>Unfortunately nothing reliably reproduces it. This is one of those annoying situations where everything is working fine for a week and then all of a sudden it goes down. I'm going to setup a script that will email me when my disk space goes over 90%, so hopefully that will help identify the issue.</div>
<div><br></div><div>Here is some additional version and disk usage information that may be useful</div><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div><div><font face="courier new, monospace">$ df -h</font></div>
</div><div><div><font face="courier new, monospace">Filesystem Size Used Avail Use% Mounted on</font></div></div><div><div><font face="courier new, monospace">rootfs 10G 6.9G 2.7G 73% /</font></div></div>
<div><div><font face="courier new, monospace">/dev/root 10G 6.9G 2.7G 73% /</font></div></div><div><div><font face="courier new, monospace">none 899M 0 899M 0% /dev</font></div></div><div><div>
<font face="courier new, monospace">tmpfs 180M 4.1M 176M 3% /run</font></div></div><div><div><font face="courier new, monospace">tmpfs 5.0M 0 5.0M 0% /run/lock</font></div></div><div><div><font face="courier new, monospace">tmpfs 360M 0 360M 0% /run/shm</font></div>
</div><div><font face="courier new, monospace"><div>$ cat /proc/version</div><div>Linux version 3.3.8-gcg-201305291443 (<a href="mailto:nobody@google.com">nobody@google.com</a>) (gcc version 4.6.x-google 20111101 (prerelease) (Google_crosstoolv15-gcc-4.6.x-glibc-2.11.1-grte) ) #1 SMP Wed May 29 14:49:59 PDT 2013</div>
<div><br></div></font></div></blockquote><div class="gmail_extra">Appreciate the help.</div><div class="gmail_extra"><br></div><div class="gmail_extra">Best,</div><div class="gmail_extra"><br clear="all"><div>Michael Sander<div>
<a href="mailto:michael.sander@gmail.com" target="_blank">michael.sander@gmail.com</a><br>607-227-9859</div></div>
<br><br><div class="gmail_quote">On Tue, Oct 29, 2013 at 8:23 AM, Michael Klishin <span dir="ltr"><<a href="mailto:mklishin@gopivotal.com" target="_blank">mklishin@gopivotal.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div class="im">On 29 Oct 2013, at 08:56, Michael Sander <<a href="mailto:michael.sander@gmail.com">michael.sander@gmail.com</a>> wrote:<br>
<br>
</div>> ** Reason for termination ==<br>
> ** {{badmatch,[]},<br>
> [{rabbit_disk_monitor,parse_free_unix,1,[]},<br>
> {rabbit_disk_monitor,internal_update,1,[]},<br>
> {rabbit_disk_monitor,handle_info,2,[]},<br>
> {gen_server,handle_msg,5,[{file,"gen_server.erl"},{line,607}]},<br>
> {proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,227}]}]}<br>
> =INFO REPORT==== 28-Oct-2013::19:48:36 ===<br>
> Disabling disk free space monitoring on unsupported platform: {{'EXIT',<br>
> {{badmatch,[]},<br>
> [{rabbit_disk_monitor,<br>
> parse_free_unix,<br>
> 1,[]},<br>
> {rabbit_disk_monitor,<br>
> init,1,[]},<br>
> {gen_server,<br>
> init_it,6,<br>
> [{file,<br>
> "gen_server.erl"},<br>
> {line,<br>
> 304}]},<br>
> {proc_lib,<br>
> init_p_do_apply,<br>
> 3,<br>
> [{file,<br>
> "proc_lib.erl"},<br>
> {line,<br>
> 227}]}]}},<br>
> 1887428608}<br>
<br>
Michael,<br>
<br>
Is there a more or less reliable way to reproduce the issue? E.g. what OS, RabbitMQ<br>
version and RabbitMQ configuration can we try? What is your workload like?<br>
<br>
Thank you.<br>
<br>
MK<br>
<br>
Software Engineer, Pivotal/RabbitMQ<br>
<br>
<br>
<br>
</blockquote></div><br></div></div>