Just fyi to follow up to this<div><br></div><div>I created a 32GB swap on an EBS volume on an amzn mid-level instance (8GB RAM)</div><div><br></div><div>I was able to hammer rabbit with far more messages than I've ever been able to store. Once it crossed into swap amazingly write speed only suffered slightly (probably because the old messages were swapped out, not the new ones), but get speed did suffer. The important part is that the server stayed up, even after using 20GB of virtual RAM (millions of large messages)</div>
<div><br></div><div>I did not alter rabbit or the configuration in any way. I am using the version in apt. As a matter of fact, that memory warn config parameter was not recognized by rabbit and would put a warning in the log when it started.</div>
<div><br></div><div><br></div><div><br></div><div><br><div class="gmail_quote">On Mon, Apr 27, 2009 at 11:51 AM, Brian Whitman <span dir="ltr"><<a href="mailto:brian@echonest.com">brian@echonest.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div><div class="gmail_quote">On Mon, Apr 27, 2009 at 10:04 AM, Alexis Richardson <span dir="ltr"><<a href="mailto:alexis.richardson@gmail.com" target="_blank">alexis.richardson@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Brian<div class="im"><br>You may find this blog post relevant:<br>
<a href="http://www.lshift.net/blog/2009/04/02/cranial-surgery-giving-rabbit-more-memory" target="_blank">http://www.lshift.net/blog/2009/04/02/cranial-surgery-giving-rabbit-more-memory</a></div></blockquote><div><br></div>
<div>
<br></div><div>Ah great, putting an EBS swap behind it is probably a good temp solution. I'll give that a go and run some tests. Thanks for the pointer. I wouldn't recommend anyone use S3 for this-- we max out at about 40-50 "keys"/files a second from other ec2 instances.</div>
<div><br></div><div><br></div></div></div>
</blockquote></div><br></div>