[rabbitmq-discuss] rabbitmq-discuss Digest, Vol 18, Issue 34
ilya at aiderss.com
Tue Nov 18 03:23:04 GMT 2008
> I've setup a simple consumer which pushes ~10kb/s into a Rabbit queue,
> Presumably you mean a *producer*. Is that producer publishing the messages
> as fast as it can, or is it rate-limited?
Yes, my bad, should have said 'producer'.
> And how did you measure the rate?
Monitoring network IO with collectl on the RabbitMQ box.
> the memory appears to be fluctuating all over the map.
> Large fluctuations in memory are nothing unusual in most garbage-collected
Sure, though order of magnitude? 300 working set to 3GB? You're probably
right.. in which case, damn!
> Also, I've added a liberal swap partition to the box, but I'm still seeing
> same behavior as before: rabbit died at around 2.2GB in the perister.log.
> If the producer isn't rate-limited then message backlogs can build up in
> various places throughout the system, before they ever get to the persister.
> Furthermore, unless you use transactions, messages are persisted
> asynchronously. So consequently you may have many more messages in memory
> than have been written to disk.
Interesting, I thought the semantics of 'persistent' flag guaranteed that
each messages has been committed to a journal?
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the rabbitmq-discuss