[rabbitmq-discuss] big transfers

[Holger Hoffstätte]

Jim Irrer wrote:
> Someone must have bumped into this problem before, but what is a
> good strategy for transferring very large buffers (tens or even
> hundreds of megabytes)?   No matter how the server is configured,
> a message could be sent that is too large to handle.

The typical approach is to take the broker out of the critical path and
only send metadata, i.e. the necessary information for a client to
retrieve the payload: file path, url, encoding (e.g. compression), size
(to allow for up front allocation and possibly rejection in case the local
node is not up for it) etc. so that the consumer can pick up the big
message by itself.
This also implies that all clients need to be able to distinguish between
regular payloads and proxy messages, so adding this late to an
architecture can be difficult..

-h