[rabbitmq-discuss] Performance bottleneck on inter-node connection

Tue Apr 8 19:44:11 BST 2014

I am facing a performance bottleneck on the inter-node connection between
two nodes in a cluster.

Cluster configuration is as follow:

Nodes: 2 (node1 and node2)

OS: RHEL6

RabbitMQ version: 3.3.0

Erlang version: R16B03

rabbitmq.config:

[{rabbit,

  [

    {cluster_nodes, {['rabbit at node1', 'rabbit at node2'], disc}},

    {hipe_compile, true},

    {delegate_count, 32},

    {loopback_users, []}

  ]

}].

Queues are located on node1.

When producing/consuming messages of 1KB on the same node (node 1), I am
able to achieve up to 100K TPS, even more.

If I produce messages on node 2, and consume messages from node 1; I am not
able to hit more then 15K TPS. Knowing that the CPU load on the two nodes
is very relaxed (90% idle), and no bottleneck on the network bandwidth
between the nodes.

The same, if I produce on node 1, and consume on node 2; I am not able to
hit more then 15K TPS

I am suspecting a limitation on the inter-node connection between the nodes.

Is there a way to create multiple links between the nodes to scale up?

If not possible to create multiple links, Is there a way to optimize the
link performance?

Is there something else I can do to increase the performance between nodes?

Thanks for your help.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20140408/749b4aba/attachment.html>