[rabbitmq-discuss] RabbitMQ 2.6.1 hangs on start after corrupt (?) database
Eugene Kirpichov
ekirpichov at gmail.com
Wed Dec 14 15:26:51 GMT 2011
Hello,
The following sad story happened on my colleague's computer, which is on
Windows btw.
He had RabbitMQ running, then ran out of hard drive space, cleaned up some
of it, but after that RabbitMQ wouldn't start.
It would hang at "starting exchange, queue and binding recovery
...(never writes 'done')"
It didn't eat CPU or disk or anything.
The erl.exe process had a win32sysinfo.exe subprocess.
RabbitMQ started fine after he cleaned the mnesia database directory.
I'm attaching the output of rabbitmqctl start, a bunch of logs, and
rabbitmqctl report.
Looks like the logs have some failing stack traces, so I believe this
should be enough to diagnose the problem.
Is this a known issue that's been fixed in later versions?
Thanks.
--
Eugene Kirpichov
Principal Engineer, Mirantis Inc. http://www.mirantis.com/
Editor, http://fprog.ru/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111214/cc6d96b4/attachment.htm>
-------------- next part --------------
Activating RabbitMQ plugins ...
6 plugins activated:
* amqp_client-2.6.1
* mochiweb-1.3-rmq2.6.1-git9a53dbd
* rabbitmq_management-2.6.1
* rabbitmq_management_agent-2.6.1
* rabbitmq_mochiweb-2.6.1
* webmachine-1.7.0-rmq2.6.1-hg0c4b60a
+---+ +---+
| | | |
| | | |
| | | |
| +---+ +-------+
| |
| RabbitMQ +---+ |
| | | |
| v2.6.1 +---+ |
| |
+-------------------+
AMQP 0-9-1 / 0-9 / 0-8
Copyright (C) 2007-2011 VMware, Inc.
Licensed under the MPL. See http://www.rabbitmq.com/
node : rabbit at PC-XXXX
app descriptor : c:/Program Files/RabbitMQ Server/rabbitmq_server-2.6.1/sbin/../
ebin/rabbit.app
home dir : C:\Documents and Settings\xxxx
config file(s) : (none)
cookie hash : Hhk3jEOtwmGJum0J9RhHuA==
log : C:/Documents and Settings/xxxx/Application Data/RabbitMQ/l
og/rabbit at PC-XXXX.log
sasl log : C:/Documents and Settings/xxxx/Application Data/RabbitMQ/l
og/rabbit at PC-XXXX-sasl.log
database dir : c:/Documents and Settings/xxxx/Application Data/RabbitMQ/d
b/rabbit at PC-XXXX-mnesia
erlang version : 5.8.1.1
-- rabbit boot start
starting file handle cache server ...done
starting worker pool ...done
starting database ...done
starting codec correctness check ...done
-- external infrastructure ready
starting plugin registry ...done
starting auth mechanism cr-demo ...done
starting auth mechanism amqplain ...done
starting auth mechanism plain ...done
starting statistics event manager ...done
starting logging server ...done
starting exchange type direct ...done
starting exchange type fanout ...done
starting exchange type headers ...done
starting exchange type topic ...done
-- kernel ready
starting alarm handler ...done
starting node monitor ...done
starting cluster delegate ...done
starting guid generator ...done
starting memory monitor ...done
-- core initialized
starting empty DB check ...done
starting management agent ...done
starting exchange, queue and binding recovery ...<hangs here>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: rabbit at PC-XXXX.log
Type: application/octet-stream
Size: 1172 bytes
Desc: not available
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111214/cc6d96b4/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: rabbit at PC-XXXX.log.1
Type: application/octet-stream
Size: 1171 bytes
Desc: not available
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111214/cc6d96b4/attachment-0001.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: rabbit at PC-XXXX-sasl.log
Type: application/octet-stream
Size: 3426 bytes
Desc: not available
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111214/cc6d96b4/attachment-0002.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: rabbit at PC-XXXX-sasl.log.1
Type: application/octet-stream
Size: 3423 bytes
Desc: not available
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111214/cc6d96b4/attachment-0003.obj>
-------------- next part --------------
Reporting server status on {{2011,12,14},{15,8,12}}
Status of node 'rabbit at PC-XXXX' ...
[{pid,3700},
{running_applications,
[{os_mon,"CPO CXC 138 46","2.2.5"},
{sasl,"SASL CXC 138 11","2.1.9.2"},
{rabbitmq_mochiweb,"RabbitMQ Mochiweb Embedding","2.6.1"},
{mochiweb,"MochiMedia Web Server","1.3-rmq2.6.1-git9a53dbd"},
{inets,"INETS CXC 138 49","5.5"},
{mnesia,"MNESIA CXC 138 12","4.4.15"},
{stdlib,"ERTS CXC 138 10","1.17.1"},
{kernel,"ERTS CXC 138 10","2.14.1"}]},
{os,{win32,nt}},
{erlang_version,
"Erlang R14B (erts-5.8.1.1) [smp:4:4] [rq:4] [async-threads:30]\n"},
{memory,
[{total,16613712},
{processes,5623444},
{processes_used,5618028},
{system,10990268},
{atom,888869},
{atom_used,860516},
{binary,155328},
{code,7981680},
{ets,621700}]}]
Cluster status of node 'rabbit at PC-XXXX' ...
[{nodes,[{disc,['rabbit at PC-XXXX']}]},
{running_nodes,['rabbit at PC-XXXX']}]
Application environment of node 'rabbit at PC-XXXX' ...
[{auth_backends,[rabbit_auth_backend_internal]},
{auth_mechanisms,['PLAIN','AMQPLAIN']},
{backing_queue_module,rabbit_variable_queue},
{cluster_nodes,[]},
{collect_statistics,fine},
{collect_statistics_interval,5000},
{default_permissions,[<<".*">>,<<".*">>,<<".*">>]},
{default_user,<<"guest">>},
{default_user_tags,[administrator]},
{default_vhost,<<"/">>},
{delegate_count,16},
{frame_max,131072},
{included_applications,[]},
{msg_store_file_size_limit,16777216},
{msg_store_index_module,rabbit_msg_store_ets_index},
{queue_index_max_journal_entries,262144},
{server_properties,[]},
{ssl_listeners,[]},
{ssl_options,[]},
{tcp_listen_options,[binary,
{packet,raw},
{reuseaddr,true},
{backlog,128},
{nodelay,true},
{exit_on_close,false}]},
{tcp_listeners,[5672]},
{trace_vhosts,[]},
{vm_memory_high_watermark,0.4}]
Connections:
Channels:
Queues on /:
Exchanges on /:
name type durable auto_delete internal arguments
amq.direct direct true false false []
amq.topic topic true false false []
amq.rabbitmq.trace topic true false false []
amq.rabbitmq.log topic true false false []
amq.fanout fanout true false false []
amq.headers headers true false false []
direct true false false []
amq.match headers true false false []
Bindings on /:
Consumers on /:
Permissions on /:
user configure write read
guest .* .* .*
End of server status report
...done.
More information about the rabbitmq-discuss
mailing list