[rabbitmq-discuss] Socket Error 104 when connecting to rabbit cluster

[Rubo Liang]

Hi,

I have a rabbit cluster with 3 servers. I got error message like following
when trying to connect to it (the cluster has worked well for 2 days):

Socket Error on fd 3: 104

Details:

The cluster has 3 servers: A, B, C. Clients connect to server A. I run
'rabbitmqctl
stop_app; rabbitmqctl reset; rabbitmqctl start_app' on Server A to bring
the service back. Then I try to connect to server B but get the same error.

I can telnet rabbit port on server B.

~$ rabbitmqctl list_queues
Listing queues ...
ha.snssdk.log   0
ha.snssdk.log.dispatch  0
ha.snssdk.log.output    0
...done.

'rabbitmqctl report' output:

https://gist.github.com/liangrubo/5982515

pika stacktrace:
  File
"/usr/local/lib/python2.7/dist-packages/pika/adapters/base_connection.py",
line 61, in __init__
    super(BaseConnection, self).__init__(parameters, on_open_callback)
  File "/usr/local/lib/python2.7/dist-packages/pika/connection.py", line
513, in __init__
    self._connect()
  File "/usr/local/lib/python2.7/dist-packages/pika/connection.py", line
804, in _connect
    self._adapter_connect()
  File
"/usr/local/lib/python2.7/dist-packages/pika/adapters/blocking_connection.py",
line 146, in _adapter_connect
    self.process_data_events()
  File
"/usr/local/lib/python2.7/dist-packages/pika/adapters/blocking_connection.py",
line 88, in process_data_events
    if self._handle_read():
  File
"/usr/local/lib/python2.7/dist-packages/pika/adapters/blocking_connection.py",
line 184, in _handle_read
    super(BlockingConnection, self)._handle_read()
  File
"/usr/local/lib/python2.7/dist-packages/pika/adapters/base_connection.py",
line 300, in _handle_read
    return self._handle_error(error)
  File
"/usr/local/lib/python2.7/dist-packages/pika/adapters/base_connection.py",
line 264, in _handle_error
    self._handle_disconnect()
  File
"/usr/local/lib/python2.7/dist-packages/pika/adapters/blocking_connection.py",
line 181, in _handle_disconnect
    self._on_connection_closed(None, True)
  File
"/usr/local/lib/python2.7/dist-packages/pika/adapters/blocking_connection.py",
line 235, in _on_connection_closed
    raise exceptions.AMQPConnectionError(*self.closing)
pika.exceptions.AMQPConnectionError: (0, '')

Any help is appreciated.

Thanks.
Robert
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130712/d5a20e90/attachment.htm>