[rabbitmq-discuss] Query

[Alexis Richardson]

Satyarth

I think you'll be ok.  See:
http://www.rabbitmq.com/blog/2012/04/25/rabbitmq-performance-measurements-part-2/

Latency will be client-dependent but the broker should not add more
than 1ms at this (transient) load.

alexis


On Wed, Jun 13, 2012 at 7:42 PM, Satyarth Negi
<snegi at buffalo-studios.com> wrote:
> Hi Alexis,
>
> Thanks for reply. My use case falls on category 2 ( two consumers processing
> each messages ). However i think i did not communicate my question about
> balanced queue size well. What i meant is : If message are received at the
> rate of 450 msgs/sec ( 25 messages per second from 20 servers, each message
> of around 200 bytes ) by the broker/exchange , am i touching the performance
> limits of the system ? My actual consumer processing will be light weight (
> parse message and store values in in-memory key-value store ).
>
> What will be approximate latency introduced by RabbitMQ ( Broker/Queuing )
> in this case ? I did check the performance benchmarks they are very helpful
> and did get some idea on what latency to expect. But if someone can think of
> to add on to that, i will appreciate very much.
>
>
> Thanks
>
>
>
> On Wed, Jun 13, 2012 at 9:59 AM, Alexis Richardson <alexis at rabbitmq.com>
> wrote:
>>
>> Satyarth,
>>
>> If I understand your case correctly you seek to implement this
>> pattern:  http://www.rabbitmq.com/tutorials/tutorial-two-python.html
>> I.e. you want to distribute your messages across two consumers,
>> equally.
>>
>> Is that correct?  If not then you can see other patterns on the pages
>> linked to above.  For example you may want both consumers to process
>> all messages.  If so then this pattern may be what you need:
>> http://www.rabbitmq.com/tutorials/tutorial-three-python.html
>>
>> You mention 'balanced queue size'.  In the first pattern above, you
>> have one queue and it grows and contracts in length, depending on how
>> many messages are in it.  If your queue gets too big then consume more
>> messages ...   And in the second pattern, you could have two queues
>> both with the same messages in them, which is also 'balanced'.
>>
>> I hope this helps,
>>
>> alexis
>>
>>
>>
>> On Tue, Jun 12, 2012 at 8:44 PM, Satyarth Negi
>> <snegi at buffalo-studios.com> wrote:
>> > Hi All,
>> >
>> > My very first message in the list. I am looking to use RabbitMQ for
>> > messaging in our framework. So here are little details of what i am
>> > trying
>> > to think of doing with RabbitMQ:
>> >
>> > 20 producers ( servers ) sending load statistics ( 25 messages per
>> > second.
>> > Can be configured to be 25 per n seconds. But we want 'n' to be as low
>> > as
>> > possible ) to RabbitMQ message exchange. 2 consumers consuming these
>> > messages to generate real time load statistics of our our servers. So
>> > that
>> > these load statistics can then be consumed by load balancing logic.
>> >
>> > Load statistics messages will be kind of serialized associative arrays (
>> > less than 200 bytes payload). And each consumer will be multithreaded
>> > process that will just update an in memory datastructure with these
>> > values.
>> >
>> > For my this scenario i am looking to use a message exchange. I am
>> > wondering
>> > if RabbitMQ is a good option to use here. Would i be able to achieve a
>> > system with fairly balanced queue size ?
>> >
>> > Thanks
>> >
>> >
>> > _______________________________________________
>> > rabbitmq-discuss mailing list
>> > rabbitmq-discuss at lists.rabbitmq.com
>> > https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>> >
>
>