[rabbitmq-discuss] Query

[Satyarth Negi]

Hi Alexis,

Thanks for reply. My use case falls on category 2 ( two consumers
processing each messages ). However i think i did not communicate my
question about balanced queue size well. What i meant is : If message are
received at the rate of 450 msgs/sec ( 25 messages per second from 20
servers, each message of around 200 bytes ) by the broker/exchange , am i
touching the performance limits of the system ? My actual consumer
processing will be light weight ( parse message and store values in
in-memory key-value store ).

What will be approximate latency introduced by RabbitMQ ( Broker/Queuing )
in this case ? I did check the performance benchmarks they are very helpful
and did get some idea on what latency to expect. But if someone can think
of to add on to that, i will appreciate very much.


Thanks



On Wed, Jun 13, 2012 at 9:59 AM, Alexis Richardson <alexis at rabbitmq.com>wrote:

> Satyarth,
>
> If I understand your case correctly you seek to implement this
> pattern:  http://www.rabbitmq.com/tutorials/tutorial-two-python.html
> I.e. you want to distribute your messages across two consumers,
> equally.
>
> Is that correct?  If not then you can see other patterns on the pages
> linked to above.  For example you may want both consumers to process
> all messages.  If so then this pattern may be what you need:
> http://www.rabbitmq.com/tutorials/tutorial-three-python.html
>
> You mention 'balanced queue size'.  In the first pattern above, you
> have one queue and it grows and contracts in length, depending on how
> many messages are in it.  If your queue gets too big then consume more
> messages ...   And in the second pattern, you could have two queues
> both with the same messages in them, which is also 'balanced'.
>
> I hope this helps,
>
> alexis
>
>
>
> On Tue, Jun 12, 2012 at 8:44 PM, Satyarth Negi
> <snegi at buffalo-studios.com> wrote:
> > Hi All,
> >
> > My very first message in the list. I am looking to use RabbitMQ for
> > messaging in our framework. So here are little details of what i am
> trying
> > to think of doing with RabbitMQ:
> >
> > 20 producers ( servers ) sending load statistics ( 25 messages per
> second.
> > Can be configured to be 25 per n seconds. But we want 'n' to be as low as
> > possible ) to RabbitMQ message exchange. 2 consumers consuming these
> > messages to generate real time load statistics of our our servers. So
> that
> > these load statistics can then be consumed by load balancing logic.
> >
> > Load statistics messages will be kind of serialized associative arrays (
> > less than 200 bytes payload). And each consumer will be multithreaded
> > process that will just update an in memory datastructure with these
> values.
> >
> > For my this scenario i am looking to use a message exchange. I am
> wondering
> > if RabbitMQ is a good option to use here. Would i be able to achieve a
> > system with fairly balanced queue size ?
> >
> > Thanks
> >
> >
> > _______________________________________________
> > rabbitmq-discuss mailing list
> > rabbitmq-discuss at lists.rabbitmq.com
> > https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20120613/9a1ddf60/attachment.htm>