[rabbitmq-discuss] Load balancing with multiple consumers on a single queue

[David.Corcoran at edftrading.com]

rabbitmq-discuss-bounces at lists.rabbitmq.com wrote on 31/07/2008 09:32:48:

> Sorry, didn't think this one through enough! Of course you can't ack
> before you process the tasks in case the client dies before actually
> doing the work and the messages are lost.
>

Hey Gordon,

Yeah this is the same problem with cancelling the consumer. You have to ack
what you're working on first which is a bit dangerous.

> So for this to be of any use you would have to finish processing your
> current task, ack that then requeue everything everything else. That may
> be less attractive an option if it happens often as it removes the value
> of the prefetch.

It also means the grid could be idle while I'm doing that. For example if
I'm working on a 10 minute task with other tasks in the local queue behind
it and there are idle consumers on the grid.

It's a tough problem but once it's solved it'll be great. We've looked at
lots of other grid solutions and none of them can do this. RabbitMQ is the
closest we've gotten.

Dave


*********************************************************************
This communication contains confidential information, some or all of which may be privileged. It is for the intended recipient only and others must not disclose, distribute, copy, print or rely on this communication. If an addressing or transmission error has misdirected this communication, please notify the sender by replying to this e-mail and then delete the e-mail. E-mail sent to EDF Trading may be monitored by the company. Thank you. 
EDF Trading Limited
80 Victoria Street, 3rd Floor, Cardinal Place, London, SW1E 5JL
A Company registered in England No. 4255974. 
Switchboard: 020 7061 4000
EDF Trading Markets Limited is a member of the EDF Trading Limited Group and is authorised and regulated by the Financial Services Authority.
VAT number: GB 735 5479 07
*********************************************************************