[rabbitmq-discuss] New Persister

Sun Mar 21 22:26:24 GMT 2010

I'm trying to find out when the new persister will be available. I've seen
mention that it was to be ready by July of last year (
http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/2009-June/003667.html),
and further mention in November of it not being ready yet (
http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/2009-November/005386.html
).

The reason I ask is that we are attempting to publish ~1000 msgs/sec on a
single rabbit node, in a persisted queue. The queue is then read by a java
app on a geographically distant server over the internet, using
basic.consume. We also require transactional consumption, so currently wrap
a batch of X (500 for example) messages in a transaction, acking the last
one (passing true to ack multiple). We have qos set to batch size * 2 (1000
in the above example).

We're only managing to get something like 50 or so msgs/sec at the moment.
The consumption of the messages is slow, but the tx.commit varies in speed
from a second to many (sometimes even as long as a minute).

The version of rabbitmq we currently have installed is 1.7.0. We are
planning to test with 1.7.2 later today to see if this helps any.

What are we doing wrong?

Scott Mohekey
Systems/Application Specialist – Fleet – Telogis, Inc.
www.telogis.com  www.telogis.co.nz
+1 949 625-4115 ext. 207 (USA)  +64 3339 2825 x207 (NZ)

Leading Global Platform for Location Based Services
--
This e-mail, and any attachments, is intended only for use by the
addressee(s) named herein and may contain legally privileged and/or
confidential information.  It is the property of Telogis.  If you are not
the intended recipient of this e-mail, you are hereby notified that any
dissemination, distribution or copying of this e-mail, any attachments
thereto, and use of the information contained, is strictly prohibited.  If
you have received this e-mail in error, please notify the sender and
permanently delete the original and any copy there of.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20100322/962ecf03/attachment.htm 