[rabbitmq-discuss] Consumers stopped consuming messages
flocha2000-agile at yahoo.fr
Tue Jul 20 09:55:30 BST 2010
Our team is in a spike sprint to choose between ActiveMQ or RabbitMQ.
We made 2 little producer/consumer spikes sending an object message
with an array of 16 strings, a timestamp, and 2 integers. The spikes are
ok on our devs machines (messages are well consumed).
Then came the benchs. We first noticed that somtimes, on our
machines, when we were sending a lot of messages the consumer was
sometimes hanging. It was there, but the messsages were accumulating in
When we went on the bench plateform :
cluster of 2 rabbitmq machines 4 cores/3.2Ghz, 4Gb RAM, load
balanced by a VIPone to 6 consumers running on the rabbitmq machines, saving the
messages in a mysql DB (same type of machine for the DB)12 producers running on 12 AS machines (tomcat), attacked with
jmeter running on another machine. The load is about 600 to 700 http
request per second, on the servlets that produces the same load of
We noticed that sometimes, consumers hang (well, they
are not blocked, but they dont consume messages anymore). We can see
that because each consumer save around 100 msg/sec in database, so when
one is stopping consumming, the overall messages saved per seconds in DB
fall down with the same ratio (if let say 3 consumers stop, we fall
around 600 msg/sec to 300 msg/sec).
During that time, the producers are ok, and still produce at the
jmeter rate (around 600 msg/sec). The messages are in the queues and
taken by the consumers still "alive".
We load all the servlets with the producers first, then launch all
the consumers one by one, checking if the connexions are ok, then run
We are sending messages to one direct exchange. All consumers are
listening to one persistent queue bounded to the exchange.
That point is major for our choice. Have you seen this with rabbitmq,
do you have an idea of what is going on ?
FYI there has been a similar issue here, but it wasn't resolved : http://old.nabble.com/Consumer-stop-to-receive-messages-but-continue-listening-queue-problem.-td27872888.html
Thank you for your answers.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the rabbitmq-discuss