[rabbitmq-discuss] Consumer slows down (a lot) after producer exceeds a certain publish rate, why?

[Zhibo Wei]

3.15 rabbitmq-server
3.15 java-client (consumer)
3.04 erlang (producer)
ec2 m1.large
1 durable queue. no exchange.
Producer has 5 connections, each connection holds 20 channels.
Consumer has only 1 connection, who holds 20 channels, autoack = true.

If the publish rate is equal or below 15000msgs/sec, then the consumer can
hold it up (Queue never grows). However, if the publish rate exceeds
15,000, say 18,000 msgs/sec, then the delivery rate will drop to
400~2000/sec, then queue starts paging, blocks producer, and then
everything crashes.

The CPU and memory usages are just fine, but I'm not sure what else could
cause such problem. Bandwidth? Socket buffer size?

Anyone saw this kind of issue before? Any clues? Any other things I should
check?

Thanks,
Zhibo
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130927/227e7e42/attachment.htm>