[rabbitmq-discuss] AMQP header sizes an issue?

[Alexis Richardson]

Gene

Sorry for being slow - it's the holiday season in the UK where many of
us are based.

IIRC the header is around 40 bytes so you may want to batch.  Shovel
is primarily a relay does not do message batching.  The plugin is
implemented as an embedded client.  You could modify it to batch but
it may be better to batch at the producer(s).  This is not hard to
do...

Let us know if this helps, and how you get on!

alexis



On Thu, Apr 21, 2011 at 5:59 AM, ristretto.rb <ristretto.rb at gmail.com> wrote:
> Hi all,
>
> We have a large amount of incoming data (400mb/sec) all of which is
> small, mostly 20 bytes, occasionally 200 bytes.
>
> Is the AMQP header going to hurt us by being a major percentage of
> what we send, if we send each bit of data in it's own message?  If so,
> is there an easy way to batch messages, thereby getting the amount of
> data / message something that makes the header less of a factor?
>
> We are looking into rabbitmq-shovel.  Although this looks very nice
> for round rabbiting, I have yet to determine if this plugin will batch
> the data for us.
>
> thanks
> Gene
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>