Hi, Ruben...<br><br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="EN-US"><div><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">In terms of acceptable data loss, for our db�s we accept 15 minutes worth of data loss, the same level of tolerance would be acceptable for rabbitmq.</span></div>
</div></blockquote><div><br>Can you say more about the structure, both in physical terms and in application terms, of your scenario?<br><br>First, I'm assuming you have RabbitMQ brokers or clusters thereof in two or more geographically separated environments, along with whatever application infrastructure is using them (e.g. databases) replicated, in whole or in part, possibly modulo contents, at both sites?<br>
<br>What sort of work are your consumers doing in response to the messages they consume?� Does it involve committing things to databases, causing side effect-ish things to happen in the real world, etc.?<br><br>With some of those parameters specified a bit more tightly we can likely provide guidance.� We've worked with Rabbit users in the past who use shovel or federation between geographically separated sites to transmit digests or summaries of started operations or finalized state in one site to the other site.� Reviewing the properties of shovel and federation and figuring out what sort of information your case would need to send to the backup site as part of general operations is a good starting point.<br>
<br>For example, you might consider having the primary send copies of, or new messages derived from, work requests at the primary site to the secondary site, where they'll be logged somehow, likely preferably outside of Rabbit, and left dormant, to be retired when a corresponding "completed" message is generated at the primary.� Your 15 minute requirement would help you bound just how much of this you'd need to store, and give you a basis for picking at the secondary site after suspected or confirmed failure of the primary...� You'd obviously want to favor a design with idempotency of the messages so that things received twice don't have additional or different effects from the thing received once, but this is a good idea even *within* the sites on either end of your WAN connected systems...<br>
<br>Tell us more and let's digest your use case further... :-)<br><br>Best regards,<br>Jerry<br><br><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="EN-US">
<div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">�The assumption is that the failover will not be automatic but that it will have to be manually flipped to the DR site and that back ground processes would have to be started up manually.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u>�<u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Ruben.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u>�<u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> <a href="mailto:rabbitmq-discuss-bounces@lists.rabbitmq.com" target="_blank">rabbitmq-discuss-bounces@lists.rabbitmq.com</a> [mailto:<a href="mailto:rabbitmq-discuss-bounces@lists.rabbitmq.com" target="_blank">rabbitmq-discuss-bounces@lists.rabbitmq.com</a>] <b>On Behalf Of </b>Jerry Kuch<br>
<b>Sent:</b> Friday, August 03, 2012 1:54 PM<br><b>To:</b> Discussions about RabbitMQ<br><b>Subject:</b> Re: [rabbitmq-discuss] Disaster Recovery<u></u><u></u></span></p><div><div class="h5"><p class="MsoNormal"><u></u>�<u></u></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi, Ruben:<br><br>We have users that make use of Rabbit/AMQP messaging as part of cross-site DR scenarios, but one has to be thoughtful about what one is trying to do.<br>
<br>*What* is it that you want replicated between sites for DR?� Presumably more than just broker and cluster configs and their metadata since that's relatively straightforward...� Usually the question is what data, effects and business processes do you want to be able to fail over to a geographically separated site, and what sorts of guarantees do you want for the failover.� This naturally affects the design of your application and its deployment fairly intimately.<br>
<br>If you feel comfortable talking more about what you want from your scenario we can probably make some suggestions based on things we've seen done...<br><br>Best regards,<br>Jerry<br><br><u></u><u></u></p><div><p class="MsoNormal">
On Fri, Aug 3, 2012 at 11:29 AM, Ruben Rotteveel <<a href="mailto:ruben@fiadmin.com" target="_blank">ruben@fiadmin.com</a>> wrote:<u></u><u></u></p><div><div><p class="MsoNormal">Hi All,<u></u><u></u></p><p class="MsoNormal">
�<u></u><u></u></p><p class="MsoNormal">What is your recommendation for how to �mirror a rabbitmq installation in a DR site?<u></u><u></u></p><p class="MsoNormal">�<u></u><u></u></p><p class="MsoNormal">Thanks,<u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Meiryo UI","sans-serif";color:#1f497d">Ruben Rotteveel</span><u></u><u></u></p></div></div><p class="MsoNormal" style="margin-bottom:12.0pt">
<br>_______________________________________________<br>rabbitmq-discuss mailing list<br><a href="mailto:rabbitmq-discuss@lists.rabbitmq.com" target="_blank">rabbitmq-discuss@lists.rabbitmq.com</a><br><a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a><u></u><u></u></p>
</div><p class="MsoNormal"><u></u>�<u></u></p></div></div></div></div><br>_______________________________________________<br>
rabbitmq-discuss mailing list<br>
<a href="mailto:rabbitmq-discuss@lists.rabbitmq.com">rabbitmq-discuss@lists.rabbitmq.com</a><br>
<a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a><br>
<br></blockquote></div><br>