[rabbitmq-discuss] 100% CPU usage and system crawls to a halt

Mark Nutter marknutter at gmail.com
Thu Oct 22 02:57:02 BST 2009

I have rabbitMQ 1.6 on Hardy, and I'm running into an issue where the
rabbitMQ process randomly will ramp up to 100% CPU usage and stay there.
Once this happens, all message routing crawls to a near halt and the server
has to be restarted.
A quick overview of what I have it doing: I'm taking a firehose of Twitter
statuses and throwing every single one of them into a main queue from which
they are thrown into a mySQL database. These statuses also get routed to
other smaller queues based on different routing keys like twitter user ids
and URLs. These messages come in fast, about 1000 per 10 seconds, and we
pull the messages off the queue about as fast as they come in.

I've seen a few threads discussing the 100% CPU usage problem, but no real
solutions.  Am I going about this the wrong way?  What might be causing this
problem.  Is 1.7 a better option and is there a stable package out there
that works on Hardy?  Thanks in advance for your input.

Mark Nutter
marknutter at gmail.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20091021/cff03a5b/attachment.htm 

More information about the rabbitmq-discuss mailing list