<div dir="ltr">Hi Emile Joubert,<div>How much time did it take to process messages with size in 2 GB. Did you try working in a clustered environment?<br><br>On Tuesday, March 13, 2012 2:09:22 AM UTC-4, Zabrane Mickael wrote:<blockquote class="gmail_quote" style="margin: 0;margin-left: 0.8ex;border-left: 1px #ccc solid;padding-left: 1ex;">Crystal clear. Thanks Jerry.<p>Regards,<br>Zabrane</p><p>On Mar 13, 2012, at 7:03 AM, Jerry Kuch wrote:</p><p>> Hi, Zabrane:<br>> <br>> Ultimately you'll be limited by disk space.  If a queue gets large with messages<br>> that are either unconsumed, or delivered but not ACKed, and the broker determines<br>> that it's under memory pressure, it will page messages to files on disk, blocking<br>> producers in the meantime using TCP back pressure.  The mechanism is discussed here:<br>> <br>> <a href="http://www.rabbitmq.com/memory.html" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Fwww.rabbitmq.com%2Fmemory.html\46sa\75D\46sntz\0751\46usg\75AFQjCNFBmwwrHlj1pr97P0qPVUI65ukqTg';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Fwww.rabbitmq.com%2Fmemory.html\46sa\75D\46sntz\0751\46usg\75AFQjCNFBmwwrHlj1pr97P0qPVUI65ukqTg';return true;">http://www.rabbitmq.com/<wbr>memory.html</a><br>> <br>> In practice you don't want to routinely be flirting with the memory watermark, and<br>> as a rule, its value is probably best left at the default 0.40 level.  In production<br>> you should make sure your monitoring/alerting system is watching broker memory usage,<br>> and probably the lengths and memory consumption of queues of importance to your app.<br>> If queues are getting uncharacteristically backed up, it's often because something<br>> has changed or gone wrong (unexpected producer load, crashed or buggy consumers,<br>> etc.).<br>> <br>> Best regards,<br>> Jerry<br>> <br>> ----- Original Message -----<br>> From: "Zabrane Mickael" <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="uDuXpRnDnFEJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">zabr...@gmail.com</a>><br>> To: "Tony Garnock-Jones" <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="uDuXpRnDnFEJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">tonygarnockj...@<wbr>gmail.com</a>><br>> Cc: <a href="javascript:" target="_blank" gdf-obfuscated-mailto="uDuXpRnDnFEJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">rabbitmq...@lists.<wbr>rabbitmq.com</a><br>> Sent: Monday, March 12, 2012 10:41:25 PM<br>> Subject: Re: [rabbitmq-discuss] Can RabbitMQ handle big messages?<br>> <br>> <br>> <br>> This leads me to this question: <br>> <br>> <br>> Let assume I'm able to ensure that all my messages are less than 100Kb. <br>> <br>> <br>> How many messages one RabbitMQ mode can handle at any given time? Is there any limitation? <br>> <br>> <br>> <br>> Regards, <br>> Zabrane <br>> <br>> <br>> <br>> <br>> <br>> On Mar 12, 2012, at 5:39 PM, Tony Garnock-Jones wrote: <br>> <br>> <br>> On 12 March 2012 12:23, Zabrane Mickael < <a href="javascript:" target="_blank" gdf-obfuscated-mailto="uDuXpRnDnFEJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">zabr...@gmail.com</a> > wrote: <br>> <br>> <br>> <br>> <br>> <br>> <br>> <br>> On Mar 12, 2012, at 5:02 PM, Matthew Sackman wrote: <br>> <br>> <br>> For those of us struggling to follow this, if you're currently in the <br>> act of receiving data from node X, why can't you assume node X is still <br>> alive? I.e. what is wrong with treating arbitrary data from node X as <br>> evidence it's still alive, in lieu of a heartbeat from node X? <br>> <br>> <br>> <br>> <a href="http://learnyousomeerlang.com/distribunomicon" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Flearnyousomeerlang.com%2Fdistribunomicon\46sa\75D\46sntz\0751\46usg\75AFQjCNG33Cnpv3-11V4L0U69lanEcPyR-A';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Flearnyousomeerlang.com%2Fdistribunomicon\46sa\75D\46sntz\0751\46usg\75AFQjCNG33Cnpv3-11V4L0U69lanEcPyR-A';return true;">http://learnyousomeerlang.com/<wbr>distribunomicon</a> <br>> <br>> Yes, that repeats the information that Irmo started this subthread with. It doesn't address Matthew's question at all, though. <br>> <br>> Perhaps the erlang list is a better place for us to be asking about this, Matthew, since it's not directly about Rabbit - are you on that list? I'm not currently subscribed. <br>> <br>> Tony <br>> -- <br>> Tony Garnock-Jones <br>> <a href="javascript:" target="_blank" gdf-obfuscated-mailto="uDuXpRnDnFEJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">tonygarn...@gmail.com</a> <br>> <a href="http://homepages.kcbbs.gen.nz/tonyg/" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Fhomepages.kcbbs.gen.nz%2Ftonyg%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNGL85jGFrEIcOR9KzqdhjhcCjqEdQ';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Fhomepages.kcbbs.gen.nz%2Ftonyg%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNGL85jGFrEIcOR9KzqdhjhcCjqEdQ';return true;">http://homepages.kcbbs.gen.nz/<wbr>tonyg/</a> <br>> <br>> <br>> <br>> <br>> <br>> ______________________________<wbr>_________________<br>> rabbitmq-discuss mailing list<br>> <a href="javascript:" target="_blank" gdf-obfuscated-mailto="uDuXpRnDnFEJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">rabbitmq...@lists.<wbr>rabbitmq.com</a><br>> <a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank" onmousedown="this.href='https://www.google.com/url?q\75https%3A%2F%2Flists.rabbitmq.com%2Fcgi-bin%2Fmailman%2Flistinfo%2Frabbitmq-discuss\46sa\75D\46sntz\0751\46usg\75AFQjCNEa7MyKsA1XPSVZIhQM5kBuKmKiKg';return true;" onclick="this.href='https://www.google.com/url?q\75https%3A%2F%2Flists.rabbitmq.com%2Fcgi-bin%2Fmailman%2Flistinfo%2Frabbitmq-discuss\46sa\75D\46sntz\0751\46usg\75AFQjCNEa7MyKsA1XPSVZIhQM5kBuKmKiKg';return true;">https://lists.rabbitmq.com/<wbr>cgi-bin/mailman/listinfo/<wbr>rabbitmq-discuss</a></p><p></p><p>______________________________<wbr>_________________<br>rabbitmq-discuss mailing list<br><a href="javascript:" target="_blank" gdf-obfuscated-mailto="uDuXpRnDnFEJ" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">rabbitmq...@lists.<wbr>rabbitmq.com</a><br><a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank" onmousedown="this.href='https://www.google.com/url?q\75https%3A%2F%2Flists.rabbitmq.com%2Fcgi-bin%2Fmailman%2Flistinfo%2Frabbitmq-discuss\46sa\75D\46sntz\0751\46usg\75AFQjCNEa7MyKsA1XPSVZIhQM5kBuKmKiKg';return true;" onclick="this.href='https://www.google.com/url?q\75https%3A%2F%2Flists.rabbitmq.com%2Fcgi-bin%2Fmailman%2Flistinfo%2Frabbitmq-discuss\46sa\75D\46sntz\0751\46usg\75AFQjCNEa7MyKsA1XPSVZIhQM5kBuKmKiKg';return true;">https://lists.rabbitmq.com/<wbr>cgi-bin/mailman/listinfo/<wbr>rabbitmq-discuss</a><br></p><p></p><p></p><p></p><p></p></blockquote></div></div>