[rabbitmq-discuss] RabbitMQ server connections close issue

Fri Mar 29 08:45:53 GMT 2013

Hello,

We experience a problem with rabbitMQ connection closed by client by
timeout. I cannot find any solution so I would very appreciate any help.

Our setup is following:

R14B04 erlang with hipe
rabbitmq is hipe compiled
2 RabbitMQ 3.0.4 (3.0.0 earlier with the same problem) clustered nodes
durable queue is mirrored between nodes
from 400 to 600 messages per seconds
rabbitmq-c clients with 200 ms timeout
clients use non persistent connections ( sender opens connection, publish
message, closes connection. consumer opens connection, gets N messages,
closes connection, restarts )
tcp_listener keepalive is enabled

Initially everything goes fine. But some connection are closed by client by
timeout.
It seems to me that these connection are not closed inside of RabbitMQ so
connection time steadily grows and after approx 1 day cluster average
connect time become above 200 ms.

rabbitmqctl stop_app && rabbitmqctl start_app resolves problem for one more
day.

tcpdump shows that client connection timeout occures before server sends
capabilities package.
after 10 seconds in rabbit error log appears handshake_timeout exception.

Initially (netstat -nt | wc -l) and (rabbitmqctl list_connections | wc -l)
shows very close counts
When everything goes bad  (rabbitmqctl list_connections | wc -l) twice as
much connections than (netstat -nt | wc -l)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130329/709f97e2/attachment.htm>