[rabbitmq-discuss] chunking a file to many messages

Wed Mar 9 08:52:48 GMT 2011

Hi Asaf,
I think, if you publish with the different routing keys, and on the consumer side, a server will be bound to a queue with a binding key per file, so you can have a fair dispatching on per file base.
For the re-ordering part, I have thought about the unique identifier when I was designing about my stuff, I haven't implemented that yet, but that's how I have thought for it, unless someone suggests somethings better.

Thanks
Regards
Deepak

On Mar 9, 2011, at 3:22 AM, asaf david wrote:

hello
I'm a RabbitMQ beginner. I need to handle a case where several clients can produce files for processing, which should be done in some servers. I've realized there is no native support for files transfers, so I'm going to chunk a produced file to many small messages are transfer them (similar to the answer given here<https://groups.google.com/d/msg/rabbitmq-discuss/-G39l-JJtp4/OTSd9FUJdfEJ>), and reassemble them to a whole file at the server. However there are two points i'm not sure about:

 1.  How do i make sure that different messages that belong to the same file won't end up in different servers? I want a fair dispatching between the servers on a per-file base, not per-message
 2.  How do I make sure that messages won't be reordered? should i attach an identifier to each message to mark it's location in the original file?

thanks in advance :)

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss at lists.rabbitmq.com<mailto:rabbitmq-discuss at lists.rabbitmq.com>
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20110309/b67b5d2f/attachment.htm>