[rabbitmq-discuss] Multifunctional Rabbit Architectures

[Jerry Kuch]

It's a very widely done thing and in many environments we encourage it.




On Thu, Feb 20, 2014 at 3:11 PM, Laing, Michael
<michael.laing at nytimes.com>wrote:

> I don't know if it is usual, but we use a 'proxy' cluster that faces our
> internal clients and provides a single dns name (which actually round
> robins to healthy cluster members).
>
> This allows us to forward the stream of messages to multiple clusters in
> our fabric for processing.
>
> Michael Laing
> NYTimes
>
>
> On Thu, Feb 20, 2014 at 4:54 PM, Eric Berg <eric.berg at salesforce.com>wrote:
>
>> Hi,
>> I currently have a 5 node cluster setup in production that handles 80
>> queues with an HA policy of 2 nodes, peaking at about 30M total messages
>> and 10K msg/sec all for one type of task. Our application will need queues
>> going forward for a variety of unrelated tasks but I would still like one
>> entry point as the messages typically originate from the same place, and I
>> would like to avoid multiple connections per process.
>>
>> A few questions:
>> Any reason to not keep adding nodes to the same cluster other than for
>> latency potential and queue master/slave ownership?
>> I was considering adding federation where a single upstream cluster would
>> handle all incoming messages, then several clusters downstream would
>> federate the exchanges that they needed, is this a common or unusual
>> pattern?
>> Are there any good resources for discussions or blogs where others have
>> discussed more complicated architectures?
>>
>> Thanks for your insight!
>>
>> - Eric Berg
>>
>> _______________________________________________
>> rabbitmq-discuss mailing list
>> rabbitmq-discuss at lists.rabbitmq.com
>> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss<https://urldefense.proofpoint.com/v1/url?u=https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=sF0ZnlnTVu0KrGgVA7hSe29cx%2BPGAwA3H8KZu6lkUvo%3D%0A&m=t9bT190UKviG6Y7dR%2FF8DvIeo0lE5W8dElYSTk0rYvA%3D%0A&s=d19b2ed91cbb0757984a3f534ebdb03a7dcb2efcbb1358b0440a704b63f819b9>
>>
>>
>
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
>
> https://urldefense.proofpoint.com/v1/url?u=https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=sF0ZnlnTVu0KrGgVA7hSe29cx%2BPGAwA3H8KZu6lkUvo%3D%0A&m=t9bT190UKviG6Y7dR%2FF8DvIeo0lE5W8dElYSTk0rYvA%3D%0A&s=d19b2ed91cbb0757984a3f534ebdb03a7dcb2efcbb1358b0440a704b63f819b9
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20140220/3aa214c3/attachment.html>