[rabbitmq-discuss] rabbitmq-discuss Digest, Vol 18, Issue 34

[Ilya Grigorik]

>
> I've setup a simple consumer which pushes ~10kb/s into a Rabbit queue,
>>
>
> Presumably you mean a *producer*. Is that producer publishing the messages
> as fast as it can, or is it rate-limited?
>

Yes, my bad, should have said 'producer'.


> And how did you measure the rate?
>

Monitoring network IO with collectl on the RabbitMQ box.


> the memory appears to be fluctuating all over the map.
>
> Large fluctuations in memory are nothing unusual in most garbage-collected
> languages.
>

Sure, though order of magnitude? 300 working set to 3GB? You're probably
right.. in which case, damn!


> Also, I've added a liberal swap partition to the box, but I'm still seeing
> same behavior as before: rabbit died at around 2.2GB in the perister.log.
>
> If the producer isn't rate-limited then message backlogs can build up in
> various places throughout the system, before they ever get to the persister.
> Furthermore, unless you use transactions, messages are persisted
> asynchronously. So consequently you may have many more messages in memory
> than have been written to disk.
>

Interesting, I thought the semantics of 'persistent' flag guaranteed that
each messages has been committed to a journal?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20081117/0fcd8004/attachment.htm