[rabbitmq-discuss] Phantom consumers

Thu May 15 16:08:30 BST 2014

Hi Simon,

On 15 May 2014, at 6:33 am, Simon MacMullen <simon at rabbitmq.com> wrote:

> On 14/05/14 13:53, Sam Morrison wrote:
>> Hi,
>> 
>> We've got 2 3 node rabbit clusters, one using 3.1.3 and one using 3.3.0.
>> We mirror all queues.
>> 
>> Every so often we get queues filling up in the unacked counters. When we
>> investigate we see the queue has 2 consumers both from the same client
>> address.
>> One consumer links back to a connection that doesn't exist on the client
>> or the server.
> 
> When you say "a connection that doesn't exist", how are you verifying this? What does mgmt show?

The connection exists in the rabbit management interface but when doing something like an “lsof -i” on the servers and clients I can’t see any connection with that port number. Is that correct?

Cheers,
Sam

> 
> My suspicion is that somehow the connection still does exist, at least from the server's perspective.
> 
> Cheers, Simon
> 
>> If we stop the client one of the consumers goes away but we are still
>> left with a phantom one.
>> 
>> The only way we have been able to fix this is by deleting the queue and
>> restarting the client.
>> 
>> While it is in this state the client doesn't get any messages.
>> 
>> This happens with both our clusters.
>> 
>> Anyone else seeing this or know what the issue is?
> 
> 
> -- 
> Simon MacMullen
> RabbitMQ, Pivotal