[rabbitmq-discuss] RabbitMQ cluster with potentially millions of connections

Mon Jan 28 20:42:50 GMT 2013

Hi Simon,

> I think Matthias meant to disable management altogether. Elsewhere you
> mentioned that the management overview page was very slow; this is a known
> issue with large numbers of queues / connections (which we are working on)
> so don't take that as evidence of the cluster grinding to a halt. And
> management does have some per-object overheads of its own; it would be good
> to eliminate them.
>

I'll try disabling management altogether and see what happens then - I'll
post my results. Although if you do that, it gets annoyingly difficult to
see what's going on.

> So what goes wrong when you start this many connections? (and queues - I
> assume you still have one queue per connection?) Do you run out of memory,
> does CPU reach 100%? "rabbitmqctl status" can tell you more about where
> memory is going.
>

Both CPU and RAM seem to be increasing at a stable pace and are nowhere
near the limits. At some point one node decides to lock up (=no new
connections), then another, then another... It would look very much like
running out of file handles / sockets, but those are nowhere near the
limits as well (30k out of 100k limit for open sockets) and there's nothing
in the logs. I'll do some more tests and try to play around with logging to
get some more out of this, maybe it's AWS imposing some secret limits.

Regards,
Roman
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20130128/5752b966/attachment.htm>