[rabbitmq-discuss] Throughput observation with RabbitMQ-3.1.3 and Erlang R16B01 - Single Node and Cluster Node

[Gavin M. Roy]

I'll add that using pypy instead of python shows dramatic throughput increases with pika. Also note that as of my tests, the Tornado connection adapter is the fastest and as of right now, the Blocking adapter is pretty slow due to the logic required to make it answer RabbitMQ RPC requests while being single threaded.

I've been experimenting with using librabbitmq if it's available for the low level codec to see if there are performance improvements, but that's a ways off.

Regards,

Gavin 


On Thursday, August 1, 2013 at 3:32 PM, Michael Klishin wrote:

> Priyanki Vashi:
> 
> > I have tried to with multiple producer and multiple consumer since my producer and consumer are single threaded (around 10 each) but it's the same statistics in test-1, which is around 5000 msg/sec. And since eventually we will use python clients in real application of rabbitmq, I think it would be good to know how it behaves with python clients ( in this case I chose python-pika).
> 
> As your other tests demonstrate, a single RabbitMQ node can go to 25K with your setup.
> 
> If a Python producer (or multiple instances of thee) demonstrate lower throughput, it's logical
> to suspect that publishing is the bottleneck.
> 
> I haven't done client benchmarks in a while but 5-6 KGhz is about right for Pika on CPython
> and also Bunny 0.9+ on CRuby. Java client and clients based on it easily go into the 20-25K
> range.
> 
> I can't offer any advice about possible throughput improvements with Pika but
> it's a good idea to profile your producer to see what actually takes time.
> --
> MK
> 
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com (mailto:rabbitmq-discuss at lists.rabbitmq.com)
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
> 
> 


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130801/db36c208/attachment.htm>