I am running rabbitmq server snapshot version rabbitmq-200801150657. I have 500MB of free space in my /home drive and 189MB free on / drive. Have 700MB of free memory and CPU utilization is less 10%.<br><br>I have stopped rabbit app from erl shell. Then when I restarted erl shell with the same mnesia dir, I get the following: mnesia table timeout and disk_almost_full alarm activated. In addition, application os_mon is temporarily stopped.<br>
<br>[joe@home src]$ erl -sname rabbit@home -mnesia dir '"/home/joe/temp/rabbitmq_data"' -boot start_sasl -s rabbit<br><br><br>Erlang (BEAM) emulator version 5.6 [source] [async-threads:0] [hipe] [kernel-poll:false]<br>
<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,sasl_safe_sup}<br> started: [{pid,<0.40.0>},<br> {name,alarm_handler},<br> {mfa,{alarm_handler,start_link,[]}},<br>
{restart_type,permanent},<br> {shutdown,2000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,sasl_safe_sup}<br>
started: [{pid,<0.41.0>},<br> {name,overload},<br> {mfa,{overload,start_link,[]}},<br> {restart_type,permanent},<br> {shutdown,2000},<br>
{child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,sasl_sup}<br> started: [{pid,<0.39.0>},<br> {name,sasl_safe_sup},<br>
{mfa,<br> {supervisor,start_link,<br> [{local,sasl_safe_sup},sasl,safe]}},<br> {restart_type,permanent},<br> {shutdown,infinity},<br>
{child_type,supervisor}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,sasl_sup}<br> started: [{pid,<0.42.0>},<br> {name,release_handler},<br>
{mfa,{release_handler,start_link,[]}},<br> {restart_type,permanent},<br> {shutdown,2000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br>
application: sasl<br> started_at: rabbit@home<br><br>Eshell V5.6 (abort with ^G)<br>(rabbit@home)1> <br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,os_mon_sup}<br> started: [{pid,<0.54.0>},<br>
{name,disksup},<br> {mfa,{disksup,start_link,[]}},<br> {restart_type,permanent},<br> {shutdown,2000},<br> {child_type,worker}]<br>
<br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,os_mon_sup}<br> started: [{pid,<0.55.0>},<br> {name,memsup},<br> {mfa,{memsup,start_link,[]}},<br>
{restart_type,permanent},<br> {shutdown,2000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,os_mon_sup}<br>
started: [{pid,<0.57.0>},<br> {name,cpu_sup},<br> {mfa,{cpu_sup,start_link,[]}},<br> {restart_type,permanent},<br> {shutdown,2000},<br>
{child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> application: os_mon<br> started_at: rabbit@home<br><br>=INFO REPORT==== 12-Mar-2008::18:24:47 ===<br> alarm_handler: {set,{{disk_almost_full,"/"},[]}}<br>
<br>=INFO REPORT==== 12-Mar-2008::18:24:47 ===<br> alarm_handler: {set,{{disk_almost_full,"/home"},[]}}<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,kernel_safe_sup}<br>
started: [{pid,<0.62.0>},<br> {name,timer_server},<br> {mfa,{timer,start_link,[]}},<br> {restart_type,permanent},<br> {shutdown,1000},<br>
{child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,mnesia_sup}<br> started: [{pid,<0.63.0>},<br> {name,mnesia_event},<br>
{mfa,{mnesia_sup,start_event,[]}},<br> {restart_type,permanent},<br> {shutdown,30000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br>
supervisor: {local,mnesia_kernel_sup}<br> started: [{pid,<0.65.0>},<br> {name,mnesia_monitor},<br> {mfa,{mnesia_monitor,start,[]}},<br> {restart_type,permanent},<br>
{shutdown,3000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,mnesia_kernel_sup}<br> started: [{pid,<0.66.0>},<br>
{name,mnesia_subscr},<br> {mfa,{mnesia_subscr,start,[]}},<br> {restart_type,permanent},<br> {shutdown,3000},<br> {child_type,worker}]<br>
<br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,mnesia_kernel_sup}<br> started: [{pid,<0.67.0>},<br> {name,mnesia_locker},<br> {mfa,{mnesia_locker,start,[]}},<br>
{restart_type,permanent},<br> {shutdown,3000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,mnesia_kernel_sup}<br>
started: [{pid,<0.68.0>},<br> {name,mnesia_recover},<br> {mfa,{mnesia_recover,start,[]}},<br> {restart_type,permanent},<br> {shutdown,180000},<br>
{child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,kernel_safe_sup}<br> started: [{pid,<0.70.0>},<br> {name,dets_sup},<br>
{mfa,{dets_sup,start_link,[]}},<br> {restart_type,permanent},<br> {shutdown,1000},<br> {child_type,supervisor}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br>
supervisor: {local,kernel_safe_sup}<br> started: [{pid,<0.71.0>},<br> {name,dets},<br> {mfa,{dets_server,start_link,[]}},<br> {restart_type,permanent},<br>
{shutdown,2000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,kernel_safe_sup}<br> started: [{pid,<0.75.0>},<br>
{name,disk_log_sup},<br> {mfa,{disk_log_sup,start_link,[]}},<br> {restart_type,permanent},<br> {shutdown,1000},<br> {child_type,supervisor}]<br>
<br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,kernel_safe_sup}<br> started: [{pid,<0.76.0>},<br> {name,disk_log_server},<br> {mfa,{disk_log_server,start_link,[]}},<br>
{restart_type,permanent},<br> {shutdown,2000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,inet_gethost_native_sup}<br>
started: [{pid,<0.84.0>},{mfa,{inet_gethost_native,init,[[]]}}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:24:47 ===<br> supervisor: {local,kernel_safe_sup}<br> started: [{pid,<0.83.0>},<br>
{name,inet_gethost_native_sup},<br> {mfa,{inet_gethost_native,start_link,[]}},<br> {restart_type,temporary},<br> {shutdown,1000},<br>
{child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:25:03 ===<br> supervisor: {local,mnesia_kernel_sup}<br> started: [{pid,<0.69.0>},<br> {name,mnesia_tm},<br>
{mfa,{mnesia_tm,start,[]}},<br> {restart_type,permanent},<br> {shutdown,30000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:25:03 ===<br>
supervisor: {local,mnesia_kernel_sup}<br> started: [{pid,<0.92.0>},<br> {name,mnesia_checkpoint_sup},<br> {mfa,{mnesia_checkpoint_sup,start,[]}},<br>
{restart_type,permanent},<br> {shutdown,infinity},<br> {child_type,supervisor}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:25:03 ===<br> supervisor: {local,mnesia_kernel_sup}<br>
started: [{pid,<0.93.0>},<br> {name,mnesia_snmp_sup},<br> {mfa,{mnesia_snmp_sup,start,[]}},<br> {restart_type,permanent},<br> {shutdown,infinity},<br>
{child_type,supervisor}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:25:03 ===<br> supervisor: {local,mnesia_kernel_sup}<br> started: [{pid,<0.94.0>},<br> {name,mnesia_controller},<br>
{mfa,{mnesia_controller,start,[]}},<br> {restart_type,permanent},<br> {shutdown,3000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:25:03 ===<br>
supervisor: {local,mnesia_kernel_sup}<br> started: [{pid,<0.95.0>},<br> {name,mnesia_late_loader},<br> {mfa,{mnesia_late_loader,start,[]}},<br> {restart_type,permanent},<br>
{shutdown,3000},<br> {child_type,worker}]<br><br>=PROGRESS REPORT==== 12-Mar-2008::18:25:03 ===<br> supervisor: {local,mnesia_sup}<br> started: [{pid,<0.64.0>},<br>
{name,mnesia_kernel_sup},<br> {mfa,{mnesia_kernel_sup,start,[]}},<br> {restart_type,permanent},<br> {shutdown,infinity},<br> {child_type,supervisor}]<br>
<br>=PROGRESS REPORT==== 12-Mar-2008::18:25:03 ===<br> application: mnesia<br> started_at: rabbit@home<br>RabbitMQ 200801150657 (AMQP 8-0)<br>Copyright (C) 2007 LShift Ltd., Cohesive Financial Technologies LLC., and Rabbit Technologies Ltd.<br>
Licensed under the MPL. See <a href="http://www.rabbitmq.com/">http://www.rabbitmq.com/</a><br><br>Logging to tty<br>SASL logging to tty<br><br>starting database ...<br>=CRASH REPORT==== 12-Mar-2008::18:25:33 ===<br>
crasher:<br> pid: <0.99.0><br> registered_name: []<br> exception exit: {bad_return,<br> {{rabbit,start,[normal,[]]},<br> {'EXIT',<br> {{rabbit_mnesia,init,0},<br>
{line,45},<br> match,<br> [{error,<br> {timeout_waiting_for_tables,<br> [user,user_vhost,vhost,vhost_realm,<br>
realm,user_realm,<br> exclusive_realm_visitor,realm_visitor,<br> rabbit_config,listener,binding,<br> durable_exchanges,exchange,<br>
durable_queues,amqqueue]}}]}}}}<br> in function application_master:init/4<br> initial call: application_master:init(<0.5.0>,<0.98.0>,<br> {appl_data,rabbit,<br>
[rabbit_amqqueue_monitor,<br> rabbit_gc_persist,rabbit_gensym,<br> rabbit_log,rabbit_node_monitor,<br>
rabbit_persister,<br> rabbit_realm_monitor,rabbit_sup,<br> rabbit_tcp_client_sup],<br> undefined,<br>
{rabbit,[]},<br> [rabbit,buffering_proxy,<br> rabbit_access_control,<br> rabbit_amqqueue,<br>
rabbit_amqqueue_process,<br> rabbit_binary_generator,<br> rabbit_binary_parser,<br> rabbit_channel,rabbit_channel0,<br>
rabbit_control,<br> rabbit_error_logger,<br> rabbit_exchange,rabbit_framing,<br> rabbit_framing_channel,<br>
rabbit_gc_persist,rabbit_gensym,<br> rabbit_heartbeat,rabbit_load,<br> rabbit_log,rabbit_misc,<br>
rabbit_mnesia,rabbit_monitor,<br> rabbit_networking,<br> rabbit_node_monitor,<br> rabbit_persister,<br>
rabbit_persister_sup,<br> rabbit_reader,rabbit_realm,<br> rabbit_router,rabbit_sup,<br> rabbit_tests,rabbit_ticket,<br>
rabbit_tracer,rabbit_writer,<br> tcp_acceptor,tcp_acceptor_sup,<br> tcp_client_sup,tcp_listener,<br>
tcp_listener_sup],<br> [],infinity,infinity},<br> normal)<br> ancestors: [<0.98.0>]<br>
messages: [{'EXIT',<0.100.0>,normal}]<br> links: [<0.98.0>,<0.5.0>]<br> dictionary: []<br> trap_exit: true<br> status: running<br> heap_size: 610<br> stack_size: 23<br> reductions: 92<br>
neighbours:<br><br>=INFO REPORT==== 12-Mar-2008::18:25:33 ===<br> application: rabbit<br> exited: {bad_return,<br> {{rabbit,start,[normal,[]]},<br> {'EXIT',<br> {{rabbit_mnesia,init,0},<br>
{line,45},<br> match,<br> [{error,<br> {timeout_waiting_for_tables,<br> [user,user_vhost,vhost,vhost_realm,realm,<br>
user_realm,exclusive_realm_visitor,<br> realm_visitor,rabbit_config,listener,binding,<br> durable_exchanges,exchange,durable_queues,<br>
amqqueue]}}]}}}}<br> type: temporary<br><br>=INFO REPORT==== 12-Mar-2008::18:25:33 ===<br> application: mnesia<br> exited: stopped<br> type: temporary<br><br>=INFO REPORT==== 12-Mar-2008::18:25:33 ===<br>
alarm_handler: {clear,{disk_almost_full,"/home"}}<br><br>=INFO REPORT==== 12-Mar-2008::18:25:33 ===<br> alarm_handler: {clear,{disk_almost_full,"/"}}<br><br>=INFO REPORT==== 12-Mar-2008::18:25:33 ===<br>
application: os_mon<br> exited: stopped<br> type: temporary<br>/usr/local/erlang/otp_r12b-0/lib/erlang/lib/os_mon-2.1.3/priv/bin/memsup: Erlang has closed. <br><br>