[rabbitmq-discuss] Rabbitmq boot failure with "tables_not_present"

[Zhao, Shanyu]

Hi,

We have two rabbitmq servers to form a cluster. It mostly runs great. But sometimes after redeploy, we saw some boot failure error in rabbitmq server log.

The relevant part of the log is shown below. But the problem is that we saw these log messages repeated every 7-8 seconds and can last as long as 80 minutes before rabbit finally start up correctly. During this time any connection to the rabbitmq cluster will get a disconnected exception.

Any idea on what might have caused this problem?

=INFO REPORT==== 16-Jan-2013::14:11:36 ===
Starting RabbitMQ 3.0.1 on Erlang R14B04

=INFO REPORT==== 16-Jan-2013::14:11:37 ===
Limiting to approx 924 file handles (829 sockets)

=INFO REPORT==== 16-Jan-2013::14:11:37 ===
Error description:
   {case_clause,{error,tables_not_present}}

Log files (may contain more information):
   /var/log/rabbitmq/rabbit at ip-10-0-2-97.log
   /var/log/rabbitmq/rabbit at ip-10-0-2-97-sasl.log

Stack trace:
   [{rabbit_mnesia,discover_cluster,1},
    {rabbit_mnesia,init_from_config,0},
    {rabbit_mnesia,init,0},
    {rabbit,'-run_boot_step/1-lc$^1/1-1-',1},
    {rabbit,run_boot_step,1},
    {rabbit,'-start/2-lc$^0/1-0-',1},
    {rabbit,start,2},
    {application_master,start_it_old,4}]


=INFO REPORT==== 16-Jan-2013::14:11:38 ===
    application: rabbit
    exited: {bad_return,
                {{rabbit,start,[normal,[]]},
                 {'EXIT',
                     {rabbit,failure_during_boot,
                         {case_clause,{error,tables_not_present}}}}}}
type: temporary


I really appreciate any insight into this problem!

Thanks,
Shanyu

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
"I always like to point out that it isn't methodologies that succeed or fail, it's teams that succeed or fail. Taking on a process can help a team raise its game, but in the end it's the team that matters and carries the responsibility to do what works for them."
--by Martin Fowler

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130116/473989c4/attachment.htm>