[rabbitmq-discuss] how to get higher throughput?

Wed Mar 28 20:23:24 BST 2012

Hi

I have a use case which is very similar to RPC:
The clients subscribe to their own queues bound to routing key
"response.myname",
and they publish messages with routing key "request.myname", then wait for
response.

On the other side of the broker, there is this RPC queue, bound to routing
key "request.#",
many workers consume from this queue, process the messages then send back
response.

The request size is around 10K bytes, response is just few bytes, and all
"RPC"s are synchronized calls.
i.e. client wait for response before send another request.

After some benchmark tests, we found that the message rate of the RPC queue
hits around 1400.
It doesn't help by increasing the number of publishers or consumers, or
both.

Hope it's enough background info to finally ask my question:
what could possibly be the bottleneck in my tests, and how to get higher
throughput ?

-----------------env-------------------
Rabbit version: 2.7.1
Memory high watermark: 25G
CPU (24 processors) model: Intel(R) Xeon(R) CPU X5690  @ 3.47GH

BRs
/stone
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20120328/8944b2d7/attachment.htm>