[rabbitmq-discuss] Per Connection Throttling

Laing, Michael michael.laing at nytimes.com
Mon Mar 17 21:35:24 GMT 2014


We are preparing now to reach those rates but will do so running lots of
rabbits in parallel in an autoscaling layer to lower the per rabbit msg
rate and buffering requirements.

We persist directly to Cassandra from each rabbit and continue the
processing chain from there.

ml


On Mon, Mar 17, 2014 at 5:08 PM, Sean Allen <sean at monkeysnatchbanana.com>wrote:

> Post a really large number of messages to an exchange and not get
> throttled with per connection throttling. What possible strategies do I
> have to deal with this?
>
> Batching into larger messages is possible but creates issues elsewhere.
>
> Would posting to the same exchange with different routing keys that go to
> are bound to different queues both on the same node and on different nodes
> help?
>
> For some idea, we would be generating at least 500k to 1 million messages
> a second for some extended period of time before it dies down occasionally
> and then picks back up again.
>
> Any advice is appreciated. Thanks.
>
> --
>
> Ce n'est pas une signature
>
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20140317/74ea15b2/attachment.html>


More information about the rabbitmq-discuss mailing list