[rabbitmq-discuss] problem with new persiter with 1000 topics/queues

[Matthias Radestock]

Alex,

alex chen wrote:
> yes 1000 queues and 1000 connections.  this 4 GB was after 200 GB 
> messages were consumed.
> If the broker is started fresh with 1000 queues and connections but no 
> messages published, the mem usage is 260 MB.

Memory fragmentation will result in a figure higher than 260MB when the 
broker goes idle, but 4GB seems a bit much. It's possible that the 
memory is being taken up by the processes handling connections and/or 
channels. That is not something we have seen before, but the scenario 
you are describing - lots of connections that are all idle - is not very 
common.

> we run it once a minute to monitor the queue length.

That should actually be fine; 60s is plenty for the queues to go to 
sleep. Though waking them all up again will cause some memory and CPU 
pressure. FWIW, the management plugin can monitor queues without 
interfering with their sleeping patterns.


Regards,

Matthias.