[rabbitmq-discuss] Channel error

Thu Aug 4 18:40:06 BST 2011

We upgraded to RabbitMQ 2.5.1 from 2.0.0 and have been running 2.5.1 in production for over month. We have monitoring in on rabbitmq log that alerts us whenever there's any entries in those logs that we do not expect. Basically we look for lines that match following query. 

Query Terms: 'host=rabbitmq* AND NOT
"starting TCP connection" AND NOT "closing TCP connection"
AND NOT "accepted TCP connection" AND NOT
"connection_closed_abruptly" AND NOT "timeout,running"' 

Several times within the last week or so, it alerted us with the following error in the SASL logs. Client functionality seems to be unaffected, but I'm curious to what this error means. Can anybody from the Rabbit team clarify?

=SUPERVISOR REPORT==== 3-Aug-2011::14:22:30 ===
     Supervisor: {<0.16968.672>,
                                           rabbit_channel_sup_sup}
     Context:    shutdown_error
     Reason:     shutdown
     Offender:   [{pid,<0.20327.672>},
                  {name,channel_sup},
                  {mfa,{rabbit_channel_sup,start_link,[]}},
                  {restart_type,temporary},
                  {shutdown,infinity},
                  {child_type,supervisor}]

Usage pattern -

6 fanout exchanges used for publish/subscribe pattern with 56 exclusive, auto-deleting queues (total, not each) bound to them
37 topic exchanges used for work queue pattern with 34 durable queues (total, not each) bound to them

At peak times we have less than 100 messages/sec going through RabbitMQ
Total connections = ~60-70 (2 connections each per app node, 1 for producing, 1 for consuming)
Heartbeat of 30 seconds enabled, no transactions used, work queue messages are persistent

RabbitMQ setup info -

[13:22:00 rabbitmq at rabbitmq1 /opt/rabbitmq_server/sbin] ./rabbitmqctl status
Status of node rabbit at rabbitmq1 ...
[{pid,3841},
 {running_applications,
     [{rabbitmq_management,"RabbitMQ Management Console","2.5.1"},
      {webmachine,"webmachine","1.7.0-rmq2.5.1-hg0c4b60a"},
      {rabbitmq_management_agent,"RabbitMQ Management Agent","2.5.1"},
      {amqp_client,"RabbitMQ AMQP Client","2.5.1"},
      {rabbit,"RabbitMQ","2.5.1"},
      {os_mon,"CPO  CXC 138 46","2.2.5"},
      {sasl,"SASL  CXC 138 11","2.1.9"},
      {rabbitmq_mochiweb,"RabbitMQ Mochiweb Embedding","2.5.1"},
      {mochiweb,"MochiMedia Web Server","1.3-rmq2.5.1-git9a53dbd"},
      {inets,"INETS  CXC 138 49","5.3"},
      {mnesia,"MNESIA  CXC 138 12","4.4.13"},
      {stdlib,"ERTS  CXC 138 10","1.16.5"},
      {kernel,"ERTS  CXC 138 10","2.13.5"}]},
 {os,{unix,linux}},
 {erlang_version,
     "Erlang R13B04 (erts-5.7.5) [source] [64-bit] [smp:2:2] [rq:2] [async-threads:30] [hipe] [kernel-poll:true]\n"},
 {memory,
     [{total,149009336},
      {processes,82465760},
      {processes_used,82358928},
      {system,66543576},
      {atom,1279561},
      {atom_used,1275735},
      {binary,5745136},
      {code,15200224},
      {ets,7624288}]}]
...done.