[rabbitmq-discuss] rabbitmq_status_web crashed on daylight savings time switchover, took down RabbitMQ

[Greg Campbell]

** Generic server rabbit_status_web terminating
** Last message in was get_context
** When Server state == {state,1268531993140,"Sun, 14 Mar 2010 09:59:53
GMT",

... a bunch of queue status data...

** Reason for termination ==
** {{case_clause,[]},
    [{httpd_util,rfc1123_date,1},
     {rabbit_status_web,internal_update,1},
     {rabbit_status_web,handle_call,3},
     {gen_server,handle_msg,5},
     {proc_lib,init_p_do_apply,3}]}


The server was running Pacific time, so it looks like it crashed just after
the switchover to Daylight Savings Time on the West Coast of the United
States, which occurred Sunday Morning at 10:00:00 GMT.  This occurred on
multiple machines (not clustered) simultaneously.

The underlying issue in httpd_util:rfc1123_date appears to be an Erlang bug,
which I believe has been fixed in R13B04 (we're still running R13B03 on the
server, though):
http://www.erlang.org/cgi-bin/ezmlm-cgi?2:mss:1681:201001:jffdfifdokimdicjnpcp
.

However, it might be worth ensuring that a crash in a plugin doesn't cause
the entire system to shut down.

Thanks,
Greg Campbell
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20100314/c5b6971d/attachment.htm