[rabbitmq-discuss] 10 consumers on a queue delivers 10x too many messages

Simon MacMullen simon at rabbitmq.com
Fri Jun 14 18:09:49 BST 2013


Are these numbers coming from the management plugin or are they as 
reported by your applications?

If they are coming from the management plugin, are you seeing any 
redelivered messages being reported?

If they are reported by your applications, what does the management 
plugin report? (And do the applications see the "redelivered" flag set?)

(Oh, and which version of RabbitMQ are you running?)

Cheers, Simon

On 13/06/13 18:39, David Goehrig wrote:
> Recently I've had 3 applications all start misbehaving in the same way.
> I have a topic exchange called alerts that is bound to 4 queues via the
> same routing key #
> debug, hits, words, score
> The alerts exchange is recieving 10 messages per second, which is the
> same as the number published to that exchange by the nodes processing
> messages.  The exchange shows 40
> messages per second total outbound.
> Each of the 4 queues show 10 messages per second incoming and the queues
> each have a 3 day
> TTL on the messages, with the exception of debug which has a 5 minute.
> Now debug queue as expected shows a pretty steady backlog hovering
> around 3000 message (which is correct) and with no consumers doesn't
> show any weird behavior.
> The other 3 queues each have 10 consumers bound to them and are showing
> an average of 100 message per second being delivered to each consumer,
> with each consumer recieving approximately 10 messages per second on
> average.  (the distribution doesn't look even though but more likely
> random).   These queues report 10 messages per second incoming, but show
> 100 messages per second outbound.
> Looking over the report and the configs for each queue, nothing obvious
> jumps out as to why the queues are behaving this way.  And until this
> week, they've run perfectly fine for months.
> Anyone have any idea how this could happen/
> Dave
> --
> -=-=-=-=-=-=-=-=-=-=- http://blog.dloh.org/
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss

Simon MacMullen
RabbitMQ, Pivotal

More information about the rabbitmq-discuss mailing list