[rabbitmq-discuss] RabbitMQ Shovel Connections

Thu Nov 17 13:39:46 GMT 2011

Hi Alexandru,

I still have the same issue going on.  Here's a recap:

   - I have upgraded to the latest stable (2.7.0) Rabbmitmq on all nodes.
   - Messages which should be shoveled to a remote broker stay 
   unacknowledged in the queue which Shovel is using as a source.
   - Restarting RabbitMQ on that moment isn't possible.  Killing is 
   required, often having to issue "epmd -kill"
   - When restarting RabbitMQ containing Shovel after that all messages are 
   shoveled correctly to their destination.
   - ack_mode has value "on_confirm", when changing this to "no_ack" all 
   messages get lost.

I must say that it's possible that small network interruptions happen, or 
occasional packetloss occurs... but that doesn't explain that restarting 
Rabbit, makes all messages arrive.

Here's my complete Shovel configuration (I replaced hostnames & queue 
names):

[{rabbitmq_shovel,
  [{shovels,
    [
     {scan_orders_amsterdam,
      [{sources,      [{broker,"amqp://localhost"}]},
       {destinations, [{broker, "amqp://server01"}]},
       {queue, <<"messages_server01">>},
       {ack_mode, on_confirm},
       {publish_properties, [{delivery_mode, 2}]},
       {publish_fields, [{exchange, <<"">>},
                         {routing_key, <<"assignments">>}]},
       {reconnect_delay, 5}
      ]},
     {scan_orders_gent,
      [{sources,      [{broker,"amqp://localhost"}]},
       {destinations, [{broker, "amqp://server02"}]},
       {queue, <<"messages_server02">>},
       {ack_mode, on_confirm},
       {publish_properties, [{delivery_mode, 2}]},
       {publish_fields, [{exchange, <<"">>},
                         {routing_key, <<"assignments">>}]},
       {reconnect_delay, 5}
      ]},
     {scan_orders_lebanon,
      [{sources,      [{broker,"amqp://localhost"}]},
       {destinations, [{broker, "amqp://server03"}]},
       {queue, <<"messages_server03">>},
       {ack_mode, on_confirm},
       {publish_properties, [{delivery_mode, 2}]},
       {publish_fields, [{exchange, <<"">>},
                         {routing_key, <<"assignments">>}]},
       {reconnect_delay, 5}
      ]},
     {scan_orders_pune,
      [{sources,      [{broker,"amqp://localhost"}]},
       {destinations, [{broker, "amqp://server04"}]},
       {queue, <<"messages_server04">>},
       {ack_mode, on_confirm},
       {publish_properties, [{delivery_mode, 2}]},
       {publish_fields, [{exchange, <<"">>},
                         {routing_key, <<"assignments">>}]},
       {reconnect_delay, 5}
      ]},
     {scan_orders_lodz,
      [{sources,      [{broker,"amqp://localhost"}]},
       {destinations, [{broker, "amqp://server05"}]},
       {queue, <<"messages_server05">>},
       {ack_mode, on_confirm},
       {publish_properties, [{delivery_mode, 2}]},
       {publish_fields, [{exchange, <<"">>},
                         {routing_key, <<"assignments">>}]},
       {reconnect_delay, 5}
      ]}
     ]
   }]
}].

Any idea how to troubleshoot this?

Cheers,

Jelle

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20111117/0008f429/attachment.htm>