[rabbitmq-discuss] Meez status.

[Matthias Radestock]

Matt,

matt wrote:
> Ok, I think we *might* be out of the woods.

Excellent. Keep us posted.

> We think that the frames were getting clobbered and 
> as a result killing the connection and giving us socket closed 
> exceptions.

It's not actually the frames themselves that are getting clobbered - 
their assembly and transmission is atomic - but the sequencing of them. 
Some commands, notably basic.publish, span multiple frames. These must 
all be sent back-to-back on the channel, though they can be interleaved 
with frames from other channels on the connection.

When you have multiple threads issuing commands on a channel, and some 
of these commands are multi-frame commands you can get interleaving on 
the channel itself, which results in the UnexpectedFrameError you have seen.

> This was our biggest traffic day in history - a ton of which is coming 
> from AOL.  In the last hour or so we've pushed about 48k requests 
> through a single broker and the payload is about 5k each.
> 
> That said, things are looking better.  Now we have sluggish publish 
> times because everyone's blocked on the publish.

The traffic levels you are reporting - averaging 13.3 msgs/s - are 
nowhere near the capacity of the broker. You should be able to publish 
thousands of messages per second on a single channel. So, with your 
current load, the chances of two publishes contending for the lock 
should actually be quite small.

Perhaps tasks other than the raw basicPublish call, such as preparation 
of the message, are consuming a lot of time?

> We also have a subset of export requests that should get processed
> first before others, so we'll be leveraging the priority level in the
> protocol.

Unfortunately RabbitMQ does not yet support message priorities. It's 
listed as a planned feature at 
http://www.rabbitmq.com/compatibility.html. Let us know if you really 
need it and we will try to add this feature in the next release.

> Many thanks to the rabbitMQ team.  You guys have a responsiveness that's 
> unheard of!  

Glad to have been of assistance.


Regards,

Matthias.