Hi all,<div><br></div><div>Sorry for double posting, but I wanted to start a new thread on this topic as the <a href="https://groups.google.com/forum/#!topic/rabbitmq-discuss/7grvcHWvp3s/discussion">previous one</a> had multiple angles covering multiple cases.</div><div><br></div><div>I'm having issues with the Shovel plugin, which currently makes my work with RabbitMQ difficult.<br>My goal is to get the content of a queue to a queue of a remote broker.<br><br></div><div><div style="border-style: initial; border-color: initial; ">Here's a recap:</div><div style="border-style: initial; border-color: initial; "><ul><li><span style="border-style: initial; border-color: initial; line-height: normal; ">All RabbitMQ instances run the latest stable version 2.7.0 (the problem also occurred with 2.6.1)</span></li><li><span style="border-style: initial; border-color: initial; line-height: normal; ">Messages which should be shoveled to a remote broker stay unacknowledged in the queue which Shovel is using as a source.</span></li><li><span style="border-style: initial; border-color: initial; line-height: normal; ">Restarting RabbitMQ on that moment isn't possible. &nbsp;Killing is required, often having to issue "epmd -kill"</span></li><li><span style="border-style: initial; border-color: initial; line-height: normal; ">When I restart RabbitMQ which has the Shovel plugin, all messages get delivered correctly.</span></li></ul>By default I use ack_mode with value "on_confirm". &nbsp;When I change this into "no_ack" and I run into the above situation all messages get lost.<br><br></div><div style="border-style: initial; border-color: initial; ">I must say occasional network interruptions, or occasional packetloss is a fact. &nbsp;But not to that extent it should be a problem. Besides that, it doesn't explain that restarting Rabbit, makes all messages arrive correctly all of a sudden.<br><br></div><div style="border-style: initial; border-color: initial; "><div style="border-style: initial; border-color: initial; "><span style="border-style: initial; border-color: initial; line-height: 16px; ">Here's my complete Shovel configuration (I replaced hostnames &amp; queue names):</span></div></div><div style="border-style: initial; border-color: initial; "><span style="border-style: initial; border-color: initial; line-height: 16px; "><br></span></div><div style="border-style: initial; border-color: initial; "><span style="border-style: initial; border-color: initial; line-height: 16px; "><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">[{rabbitmq_shovel,</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; [{shovels,</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; [</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp;{scan_orders_amsterdam,</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; [{sources, &nbsp; &nbsp; &nbsp;[{broker,"amqp://localhost"}]<wbr>},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{destinations, [{broker, "amqp://server01"}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{queue, &lt;&lt;"messages_server01"&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{ack_mode, on_confirm},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_properties, [{delivery_mode, 2}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_fields, [{exchange, &lt;&lt;""&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;{routing_key, &lt;&lt;"assignments"&gt;&gt;}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{reconnect_delay, 5}</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; ]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp;{scan_orders_gent,</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; [{sources, &nbsp; &nbsp; &nbsp;[{broker,"amqp://localhost"}]<wbr>},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{destinations, [{broker, "amqp://server02"}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{queue, &lt;&lt;"messages_server02"&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{ack_mode, on_confirm},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_properties, [{delivery_mode, 2}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_fields, [{exchange, &lt;&lt;""&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;{routing_key, &lt;&lt;"assignments"&gt;&gt;}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{reconnect_delay, 5}</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; ]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp;{scan_orders_lebanon,</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; [{sources, &nbsp; &nbsp; &nbsp;[{broker,"amqp://localhost"}]<wbr>},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{destinations, [{broker, "amqp://server03"}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{queue, &lt;&lt;"messages_server03"&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{ack_mode, on_confirm},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_properties, [{delivery_mode, 2}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_fields, [{exchange, &lt;&lt;""&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;{routing_key, &lt;&lt;"assignments"&gt;&gt;}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{reconnect_delay, 5}</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; ]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp;{scan_orders_pune,</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; [{sources, &nbsp; &nbsp; &nbsp;[{broker,"amqp://localhost"}]<wbr>},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{destinations, [{broker, "amqp://server04"}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{queue, &lt;&lt;"messages_server04"&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{ack_mode, on_confirm},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_properties, [{delivery_mode, 2}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_fields, [{exchange, &lt;&lt;""&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;{routing_key, &lt;&lt;"assignments"&gt;&gt;}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{reconnect_delay, 5}</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; ]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp;{scan_orders_lodz,</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; [{sources, &nbsp; &nbsp; &nbsp;[{broker,"amqp://localhost"}]<wbr>},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{destinations, [{broker, "amqp://server05"}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{queue, &lt;&lt;"messages_server05"&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{ack_mode, on_confirm},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_properties, [{delivery_mode, 2}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{publish_fields, [{exchange, &lt;&lt;""&gt;&gt;},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;{routing_key, &lt;&lt;"assignments"&gt;&gt;}]},</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; &nbsp;{reconnect_delay, 5}</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp; ]}</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp; &nbsp;]</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">&nbsp; &nbsp;}]</font></div><div style="border-style: initial; border-color: initial; text-align: left; "><font face="'courier new', monospace" style="border-style: initial; border-color: initial; ">}].</font></div><div><font face="'courier new', monospace" style="border-style: initial; border-color: initial; "><br></font></div></span></div></div><div>The problem I would like to get solved is that my messages just arrive on their destination,&nbsp;without&nbsp;having to restart Rabbit frequently.</div><div>Any pointers, work-arounds, fixes, tips are welcome.</div><div><br></div><div>Cheers,</div><div><br></div><div>Jelle</div>