[rabbitmq-discuss] Performance bottleneck on inter-node connection

[joseph rouphael]

I am facing a performance bottleneck on the inter-node connection between
two nodes in a cluster.


Cluster configuration is as follow:


Nodes: 2 (node1 and node2)

OS: RHEL6

RabbitMQ version: 3.3.0

Erlang version: R16B03

rabbitmq.config:

[{rabbit,

  [

    {cluster_nodes, {['rabbit at node1', 'rabbit at node2'], disc}},

    {hipe_compile, true},

    {delegate_count, 32},

    {loopback_users, []}

  ]

}].


Queues are located on node1.


When producing/consuming messages of 1KB on the same node (node 1), I am
able to achieve up to 100K TPS, even more.


If I produce messages on node 2, and consume messages from node 1; I am not
able to hit more then 15K TPS. Knowing that the CPU load on the two nodes
is very relaxed (90% idle), and no bottleneck on the network bandwidth
between the nodes.


The same, if I produce on node 1, and consume on node 2; I am not able to
hit more then 15K TPS


I am suspecting a limitation on the inter-node connection between the nodes.


Is there a way to create multiple links between the nodes to scale up?

If not possible to create multiple links, Is there a way to optimize the
link performance?

Is there something else I can do to increase the performance between nodes?


Thanks for your help.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20140408/749b4aba/attachment.html>