[rabbitmq-discuss] Flow control issue when shovelling messages between data centres
simonthorogood at hotmail.com
Tue May 14 17:50:06 BST 2013
We have a rabbit cluster in our existing data centre (call it DC1). This
cluster has messages (fairly large in size - around 100K) being published
to it at a rate of between 500 to 1000/s.
Recently, we introduced a new data centre with its own rabbit cluster
(DC2). Our intention is to shovel messages that originate in DC1 to DC2 and
vice versa. The DCs are connected by a fast (500Mb/s) line
We are finding that when we set up a queue in DC1 to shovel messages from
DC1 to DC2 we are triggering 'flow control' back-pressure on many of the
client connections, resulting in the production of messages in DC1 slowing
down dramatically and becoming spiky and unreliable. Memory and CPU on all
nodes in the cluster appear to be normal (i.e. well within high water-mark
Can anybody suggest why the addition of this shovelling queue should cause
such a dramatic change in cluster behavior.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the rabbitmq-discuss