[rabbitmq-discuss] Cluster Memory Usage

[Matthias Radestock]

Cameron,

On 16/11/11 20:06, Cameron Davison wrote:
> I have a cluster of 2 rabbitmq on 2 machines in the same datacenter.
> I am sending messages to them at a rate of about 250 message a second
> each message is about 2k in size on average. The software is able to
> read them back out at about the same rate. Sometime slower usually
> faster, which is why I am using a message queue. [...] There are
> about 10 publishers channels/connections, and about 30 consumer
> channels/connections. The prefetch is set to 1000 for each channel
> of the consumers. [...] The cluster is using mirrored queue and
> confirmations on the writes as well as batch acking on the consumes.

Do all the queue masters reside on the same machine? Or perhaps there is 
just one queue (in which case the answer obviously is 'yes').

Also, what machine do the publishers and consumers connect to?

Are the queues durable and the messages persistent?

> The master rabbitmq is reporting a memory usage by the erlang
> processer of about 200MB and the slave rabbitmq is reporting around
> 800MB but sometimes jumps back and forth between 400MB and 900MB
> rapidly. Is there any reason that the memory usage is so different
> between the master and the slave.

The workload of the master and slave are quite different, so a 
difference in the memory profile is not surprising.

Inspecting the memory details of the nodes with 'rabbitmqctl status', or 
with the management plug-in, might shed some light on where the memory 
is going.


Regards,

Matthias.