[rabbitmq-discuss] Getting Rid of a Faulty message

Sun Jan 15 09:16:45 GMT 2012

I have a RabbitMQ on Amazon load balancing between N processors that do
heavy image processing algorithms (running 1-8 min on an 8 core computer) .
I'm using RabbitMQ fair dispatch and message acknowledgement to make sure
the Algorithm requests are distributed fairly amongst the processors.

However once in a while I get a message that causes the processor to crash.
RabbitMQ of course (since no ack received and connection terminated) makes
sure the message goes to the next processor which also crashes because
processors share the same code.  Soon all the processors are down. They go
up again, but the faulty message stays in the system until I get the alarms
and purges the RabbitMQ queue.

The processors have a 10 years old legacy code written by multiple
mathematicians and is almost impossible to protect against all faulty data.

Is there any mechanism in RabbitMQ that can still give me load balancing
but kick out a message that cannot be processed by consumers?

Thanks

Oren
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20120115/72fe6582/attachment.htm>