[rabbitmq-discuss] 10 consumers on a queue delivers 10x too many messages

David Goehrig dave at nexttolast.com
Thu Jun 13 18:39:54 BST 2013


Recently I've had 3 applications all start misbehaving in the same way.

I have a topic exchange called alerts that is bound to 4 queues via the
same routing key #

debug, hits, words, score

The alerts exchange is recieving 10 messages per second, which is the same
as the number published to that exchange by the nodes processing messages.
The exchange shows 40
messages per second total outbound.

Each of the 4 queues show 10 messages per second incoming and the queues
each have a 3 day
TTL on the messages, with the exception of debug which has a 5 minute.

Now debug queue as expected shows a pretty steady backlog hovering around
3000 message (which is correct) and with no consumers doesn't show any
weird behavior.

The other 3 queues each have 10 consumers bound to them and are showing an
average of 100 message per second being delivered to each consumer, with
each consumer recieving approximately 10 messages per second on average.
(the distribution doesn't look even though but more likely random).   These
queues report 10 messages per second incoming, but show 100 messages per
second outbound.

Looking over the report and the configs for each queue, nothing obvious
jumps out as to why the queues are behaving this way.  And until this week,
they've run perfectly fine for months.

Anyone have any idea how this could happen/

Dave

-- 
-=-=-=-=-=-=-=-=-=-=- http://blog.dloh.org/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130613/3629ac3d/attachment.htm>


More information about the rabbitmq-discuss mailing list