<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<base href="x-msg://11/"><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Georgia;
panose-1:2 4 5 2 5 4 5 2 3 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Steve,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Ah! That was it! Thank you very much for that and sorry for my ignorance. When I had all the machines up and the messages made it to Machine A, if I restarted
it, all of the messages were still in place, so I assumed that the messages were persistant. As you indicated, this was not the case. Once I added the delivery_mode setting you suggested to my publish call, I was able to restart Machine C and the messages
were still present. Apply palm to forehead and problem solved.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thank you again for your help with this.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Sean<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Steve Powell [mailto:steve@rabbitmq.com]
<br>
<b>Sent:</b> Wednesday, April 04, 2012 7:25 AM<br>
<b>To:</b> Sean Heaton<br>
<b>Cc:</b> rabbitmq-discuss@lists.rabbitmq.com<br>
<b>Subject:</b> Re: [rabbitmq-discuss] Shovel plugin behavior with durable queues...<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Sean,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">Please check that the messages are 'persistent' messages (published with<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">BasicProperties containing delivery_mode=2). If not they won't survive a<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">restart; only persistent messages in durable queues survive a restart.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I note that you have set persistent in the shovel configuration, but<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">this only overrides the properties of the original message. If they<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">weren't persistent originally and shovel doesn't re-publish them, they<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">will be lost on restart.<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="apple-style-span"><span style="font-size:9.0pt;font-family:"Georgia","serif";color:black">Steve Powell </span></span><span class="apple-style-span"><span style="font-size:8.5pt;font-family:"Georgia","serif";color:black">(<i>a
happy bunny</i>)</span></span><span style="font-size:13.5pt;font-family:"Georgia","serif";color:black"><o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="apple-style-span"><i><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">----------some more definitions from the SPD----------</span></i></span><span style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black"><o:p></o:p></span></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span class="apple-style-span"><b><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">chinchilla</span></b></span><span class="apple-style-span"><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black"> (<i>n.</i>)
Cooling device for the lower jaw.</span></span><span style="color:black"><o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span class="apple-style-span"><b><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">socialcast</span></b></span><span class="apple-style-span"><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black"> (<i>n.</i>) Someone
to whom everyone is speaking but nobody likes.</span></span><span style="font-size:13.5pt;font-family:"Georgia","serif";color:black"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span class="apple-style-span"><b><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">literacy</span></b></span><span class="apple-converted-space"><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black"> </span></span><span class="apple-style-span"><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">(<i>n.</i>)
A textually transmitted disease usually contracted in childhood.</span></span><span style="font-size:13.5pt;font-family:"Georgia","serif";color:black"><o:p></o:p></span></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On 3 Apr 2012, at 17:46, Sean Heaton wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Steve,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thank you very much for helping me out. I actually stop Machine A. That prevents messages from being shoveled from Machine C to A. While A is still stopped,
I restart the RabbitMQ service Machine C. </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">When I do this, I figured since the messages are in a durable queue on Machine C, they would still be in the durable queue on C waiting to be shoveled to A.
This isn’t the case though—they are simply gone. They don’t make it to A (since A is stopped), but they aren’t on C anymore either. I was thinking I probably have something configured wrong or that there is a setting I can tweak to make them persist on C.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thank you again for your help on this…</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Sean</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in;border-width:initial;border-color:initial">
<div>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span class="apple-converted-space"><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> </span></span><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Steve
Powell [mailto:steve@rabbitmq.com]<span class="apple-converted-space"> </span><br>
<b>Sent:</b><span class="apple-converted-space"> </span>Tuesday, April 03, 2012 7:44 AM<br>
<b>To:</b><span class="apple-converted-space"> </span>Sean Heaton<br>
<b>Cc:</b><span class="apple-converted-space"> </span><a href="mailto:rabbitmq-discuss@lists.rabbitmq.com">rabbitmq-discuss@lists.rabbitmq.com</a><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Re: [rabbitmq-discuss] Shovel plugin behavior with durable queues...</span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">Hi Sean,<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Did you mean to say you restarted Machine C or Machine A?<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">In any case, the messages in a durable queue will only survive a server<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">stop/start if the messages are persistent.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">If you restarted Machine A, then the shovel ought to reconnect (from C<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">to A) and the messages in the queue should then be sent. Since the queue<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">on Machine A is durable it ought to still exist when you restart it.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Hope this gives some clue. If you still have problems, please come back.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="apple-style-span"><span style="font-size:9.0pt;font-family:"Georgia","serif";color:black">Steve Powell </span></span><span class="apple-style-span"><span style="font-size:8.5pt;font-family:"Georgia","serif";color:black">(<i>a
happy bunny</i>)</span></span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="apple-style-span"><i><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">----------some more definitions from the SPD----------</span></i></span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span class="apple-style-span"><b><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">chinchilla</span></b></span><span class="apple-style-span"><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black"> (<i>n.</i>)
Cooling device for the lower jaw.</span></span><o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="apple-style-span"><b><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">socialcast</span></b></span><span class="apple-style-span"><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black"> (<i>n.</i>) Someone
to whom everyone is speaking but nobody likes.</span></span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="apple-style-span"><b><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">literacy</span></b></span><span class="apple-converted-space"><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black"> </span></span><span class="apple-style-span"><span style="font-size:7.5pt;font-family:"Georgia","serif";color:black">(<i>n.</i>)
A textually transmitted disease usually contracted in childhood.</span></span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">On 2 Apr 2012, at 22:33, Sean Heaton wrote:<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Hello,</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">I am new to the list and RabbitMQ in general, so I hope this is not a stupid question, but I have seen some behavior that is strange to me when using the RabbitMQ shovel
plugin. I am using RabbitMQ v 2.7.1 running on Centos 6.0. I have three machines in my setup. Machines A and B are both clustered together. Machine C is not part of the cluster. It has the shovel plugin installed. The plugin is set up to shovel messages
from a durable queue on Machine C to a durable queue on Machine A. In case it helps, my /etc/rabbitmq/rabbitmq.conf file looks like this:</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[{rabbitmq_shovel,</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> [{shovels,</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> [{myShovel,</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> [{sources, [{broker,"<a href="amqp://MachineC">amqp://MachineC</a>"}]},</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> {destinations, [{broker, "<a href="amqp://MachineA">amqp://MachineA</a>"}]},</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> {queue, <<"myQueue">>},</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> {ack_mode, on_confirm},</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> {publish_properties, [{delivery_mode, 2}]},</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> {reconnect_delay, 5}</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> ]</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> }]</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> }]</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">}].</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">With this configuration, everything seems to work fine. When I send messages to the queue on Machine C, they are shoveled automatically out to A.</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">So here is the weird behavior I mentioned earlier… If I shut down the RabbitMQ service on Machine A, messages stack up in the durable queue on Machine C. This is expected
since Machine A is down. However, if I then restart the RabbitMQ service on Machine C, all of the messages waiting in the durable queue get nuked.</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Has anyone else seen this behavior? Do I have a setting wrong or is there something else I can change so that this doesn’t happen?</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Thanks in advance for your help!</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Regards,</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Sean</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Georgia","serif""><br clear="all">
_______________________________________________<br>
rabbitmq-discuss mailing list<br>
<a href="mailto:rabbitmq-discuss@lists.rabbitmq.com">rabbitmq-discuss@lists.rabbitmq.com</a><br>
<a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a></span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Georgia","serif""><br clear="all">
<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<br clear=all>
</body>
</html>