[rabbitmq-discuss] problem with new persiter with 1000 topics/queues

[alex chen]

Matthias,

> i increased the timeout of login from 10 sec to 5 minutes, then the

> consumers could consume the 200 GB of messages without any problems. the
> 2.1.1 broker's memory kept below 6.2 GB. (the memory usage for release
> 2.0.0 was 10 GB for this test case).

There is another problem:   The broker's memory usage grew from 6.2GB to 10 GB 1 hour after the consumers were started.
This caused swapping and the consume rate dropped from 30 MB/sec to less than 10 MB/sec.  I think the broker only throttles the publisher when the mem high water mark is reached, but the consumers can still increase the broker's mem usage?
if this cannot be avoided, we have to increase the RAM to 16GB.

thanks.

-alex


      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20101028/86472d4d/attachment-0001.htm>