Hi Alexis,<br><br>Thanks for reply. My use case falls on category 2 ( two consumers processing each messages ). However i think i did not communicate my question about balanced queue size well. What i meant is : If message are received at the rate of 450 msgs/sec ( 25 messages per second from 20 servers, each message of around 200 bytes ) by the broker/exchange , am i touching the performance limits of the system ? My actual consumer processing will be light weight ( parse message and store values in in-memory key-value store ). <br>
<br>What will be approximate latency introduced by RabbitMQ ( Broker/Queuing ) in this case ? I did check the performance benchmarks they are very helpful and did get some idea on what latency to expect. But if someone can think of to add on to that, i will appreciate very much.<br>
<br><br>Thanks<br><br><br><br><div class="gmail_quote">On Wed, Jun 13, 2012 at 9:59 AM, Alexis Richardson <span dir="ltr"><<a href="mailto:alexis@rabbitmq.com" target="_blank">alexis@rabbitmq.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Satyarth,<br>
<br>
If I understand your case correctly you seek to implement this<br>
pattern: <a href="http://www.rabbitmq.com/tutorials/tutorial-two-python.html" target="_blank">http://www.rabbitmq.com/tutorials/tutorial-two-python.html</a><br>
I.e. you want to distribute your messages across two consumers,<br>
equally.<br>
<br>
Is that correct? If not then you can see other patterns on the pages<br>
linked to above. For example you may want both consumers to process<br>
all messages. If so then this pattern may be what you need:<br>
<a href="http://www.rabbitmq.com/tutorials/tutorial-three-python.html" target="_blank">http://www.rabbitmq.com/tutorials/tutorial-three-python.html</a><br>
<br>
You mention 'balanced queue size'. In the first pattern above, you<br>
have one queue and it grows and contracts in length, depending on how<br>
many messages are in it. If your queue gets too big then consume more<br>
messages ... And in the second pattern, you could have two queues<br>
both with the same messages in them, which is also 'balanced'.<br>
<br>
I hope this helps,<br>
<br>
alexis<br>
<div><div class="h5"><br>
<br>
<br>
On Tue, Jun 12, 2012 at 8:44 PM, Satyarth Negi<br>
<<a href="mailto:snegi@buffalo-studios.com">snegi@buffalo-studios.com</a>> wrote:<br>
> Hi All,<br>
><br>
> My very first message in the list. I am looking to use RabbitMQ for<br>
> messaging in our framework. So here are little details of what i am trying<br>
> to think of doing with RabbitMQ:<br>
><br>
> 20 producers ( servers ) sending load statistics ( 25 messages per second.<br>
> Can be configured to be 25 per n seconds. But we want 'n' to be as low as<br>
> possible ) to RabbitMQ message exchange. 2 consumers consuming these<br>
> messages to generate real time load statistics of our our servers. So that<br>
> these load statistics can then be consumed by load balancing logic.<br>
><br>
> Load statistics messages will be kind of serialized associative arrays (<br>
> less than 200 bytes payload). And each consumer will be multithreaded<br>
> process that will just update an in memory datastructure with these values.<br>
><br>
> For my this scenario i am looking to use a message exchange. I am wondering<br>
> if RabbitMQ is a good option to use here. Would i be able to achieve a<br>
> system with fairly balanced queue size ?<br>
><br>
> Thanks<br>
><br>
><br>
</div></div>> _______________________________________________<br>
> rabbitmq-discuss mailing list<br>
> <a href="mailto:rabbitmq-discuss@lists.rabbitmq.com">rabbitmq-discuss@lists.rabbitmq.com</a><br>
> <a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a><br>
><br>
</blockquote></div><br>