[rabbitmq-discuss] last sticky wicket on map/reduce

Fri Oct 1 16:20:28 BST 2010

You would only need to know the number of subtasks at each stage. You would
not need to know the total number of subtasks that would be created during
the whole run.

Example... start job, make 10 subtasks, give a weight of 0.1. The total
weight is 1. Now suppose one subtask comes back and needs to be split into 4
subtasks. Give each of those weight 0.025. The grand total is still 1;
indeed it is invariant

On Oct 1, 2010 4:04 PM, "Jon Brisbin" <jon at jbrisbin.com> wrote:

On Oct 1, 2010, at 8:51 AM, Alexis Richardson wrote: > Why can't you use a
checksum instead? Each t...
Wouldn't I have to know how many subtasks I'll create total when the first
subtask goes out? I don't know that in this case.

Could you give me an example of what you're thinking?

jb

> >> On Oct 1, 2010 3:35 PM, "Jon Brisbin" <jon.brisbin at npcinternational.com>
wrote: >> >> I'm als...

Thanks!

J. Brisbin
http://jbrisbin.com/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20101001/db470dae/attachment.htm>