[rabbitmq-discuss] Consistent Exchange Only if Consumers?

[François Beausoleil]

Hi all!

Is there a knob somewhere to make x-consistent-hash exchanges deliver only to queues that have an active consumer?

My use case is dedupping before processing: I receive interactions from social networks, and the same interaction may be harvested multiple times. I have distributed caches that dedup the interactions, and am successfully using an x-consistent-hash exchange to do the deduping. I chose to use exclusive queues for the consumers, so if the consumer crashes, messages will be rerouted. Problem is, if the consumer crashes, the messages are lost.

If the x-consistent-hash exchange routed messages only if there was an active consumer, then I could use durable queues. Alternatively, on consumer crash, if the queue could redeliver the messages to the origin exchange, then I would be all right as well.

My problem is really with the messages that are in the queue when a consumer crashes. Not with mandatory, because I have dozens of queues in which to deliver the messages, so the message will be routed, and the mandatory flag will not help in this instance.

Any thoughts or ideas on this?

Thanks!
François
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4142 bytes
Desc: not available
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130215/2e617b69/attachment.bin>