[rabbitmq-discuss] Queue not shown in rabbitmqctl

Mon Dec 16 08:45:07 GMT 2013

Hello,

Today, I found RabbitMQ in a non-responsive state. It shut down due to
insufficient number of  file descriptors. The reason was that one queue was
overloaded with messages and RabbitMQ dumped a lot of messages into temp
files, keeping them open. `lsof' showed something like:

beam.smp 23236 rabbitmq   77u   REG      251,0        0    1574055
/var/lib/rabbitmq/mnesia/rabbit at d
bx/queues/B36DQ7YBKCJQXP3FJIJYVP8FR/journal.jif
beam.smp 23236 rabbitmq   78u   REG      251,0        0    1574067
/var/lib/rabbitmq/mnesia/rabbit at d
bx/queues/E2OCOOGFQWGZ7QU7V4PDME9BU/journal.jif
beam.smp 23236 rabbitmq   79u   REG      251,0        0        361
/var/lib/rabbitmq/mnesia/rabbit at dbx
/queues/A3RS8QB81UX1HCFPVOUD9SQIF/journal.jif
beam.smp 23236 rabbitmq   80u   REG      251,0        0    1574069
/var/lib/rabbitmq/mnesia/rabbit at dbx
/queues/122SUYRH75USFEOUF8UJ1E9YP/journal.jif
beam.smp 23236 rabbitmq   81u   REG      251,0        0    3411720
/var/lib/rabbitmq/mnesia/rabbit at dbx
/queues/90OT1K6VYE7TUBR6GI1CMU8BT/journal.jif
beam.smp 23236 rabbitmq   82u  IPv6 1449769938      0t0        TCP *:amqp
(LISTEN)
beam.smp 23236 rabbitmq   83r   REG      251,0 16405205    2097797
/var/lib/rabbitmq/mnesia/rabbit at dbx/msg_store_transient/1355.rdq
beam.smp 23236 rabbitmq   84r   REG      251,0 16777279    2100373
/var/lib/rabbitmq/mnesia/rabbit at dbx/msg_store_transient/21679.rdq
beam.smp 23236 rabbitmq   85r   REG      251,0 16777566    2098314
/var/lib/rabbitmq/mnesia/rabbit at dbx/msg_store_transient/19328.rdq
beam.smp 23236 rabbitmq   86r   REG      251,0 16777490    2097792
/var/lib/rabbitmq/mnesia/rabbit at dbx/msg_store_transient/19025.rdq

These journal.jif and *rdq files consumed all file handles.

But the strange thing was that the queue with 50 million messages was
visible in the management interface, but not in `rabbitmqctl list_queues'
output. What might be the cause?

And, while we're at it, shouldn't RabbtiMQ close the temporary files it
creates when there's not enough memory?

Thank you.

-- 
With best regards,
Dimitri Minaev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20131216/1aed2aa0/attachment.html>