[rabbitmq-discuss] RabbitMQ - big delays when establishing Kombu connection

[Ask Solem]

On 13 Sep 2012, at 15:04, eugene <eugene.doktorov at gmail.com> wrote:

> Hi guys,
> 
> We're experiencing big delays (2-25 secs) when using celery's send_task
> method
> 
> Our environment:
> - client: celery 3.0.7
> - server: celery 3.0.7, rabbitmq 2.8.6
> - typical ping 
> 	icmp_seq=1 ttl=64 time=0.390 ms
> 	icmp_seq=2 ttl=64 time=0.375 ms
> 	icmp_seq=3 ttl=64 time=54.6 ms
> 	icmp_seq=4 ttl=64 time=0.384 ms
> - no memory or CPU problems are observed on client or server nodes
> - delay occurs with or without using rabbitmq cluster
> 
> I investigated problem a bit:
> - enabled Kombu output on client
> - ran tcpdump on client & server
> - was not able to make Kombu log on the server side. Tried
> KOMBU_LOG_DEBUG=1 celeryd -l debug
> 
> Looking at logs I noticed that:
> - delay ALWAYS happens between the same amqp messages while establishing
> Kombu connection.(TCP connection seams to be established fast)
> - server side tcpdump reflects the same delay
> - publishing, processing & receiving results are fast.
> 
> Below is client output from Kombu & tcpdump. I redirected them into the same
> file:
> 
> Where to go from this point? I'd really appreciate some advice.

Eugene,

Have you been able to reproduce using librabbitmq instead of amqplib?