[rabbitmq-discuss] memory usage

Wed Feb 11 02:31:53 GMT 2009

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Feb 10, 2009, at 5:11 PM, Valentino Volonghi wrote:
> I'm now repeating the test again with more monitoring over requests  
> done and the size
> of the logs.

One thing that I can reproduce 100% of the time:

If I run tsung with some requests to be done and a 0.000625 inter  
arrival
time (1600 req/sec) and my system is behind nginx 0.6.35 configured as
the bottom of the email.

The central rabbitmq raises this error:

      Supervisor: {local,rabbit_amqqueue_sup}
      Context:    child_terminated
      Reason:     {timeout,
                      {gen_server,call,
                          [rabbit_persister,
                           {commit_transaction,
                               {{{1,<0.245.0>},160},
                                {resource,<<"/">>,queue,
                                    <<"log_endpoint">>}}}]}}
      Offender:   [{pid,<0.212.0>},
                   {name,rabbit_amqqueue},
                   {mfa,
                       {rabbit_amqqueue_process,start_link,
                           [{amqqueue,

{resource,<<"/">>,queue,<<"log_endpoint">>},
                                true,false,[],none}]}},
                   {restart_type,temporary},
                   {shutdown,brutal_kill},
                   {child_type,worker}]

I suppose it's because it doesn't get enough CPU time again... maybe  
this
is also the reason why it stops sending messages, because being unable
to receive them it doesn't deliver. Once this happens the frontend  
rabbitmq
for some reason jumps to 2.5GB of memory used and keeps delivering like
nothing happened, it also remains at 2.5GB even if its log files  
remain very
low in size.

# nginx.conf

worker_processes  1;

events {
     worker_connections  26000;
}

http {
     include       mime.types;
     default_type  application/octet-stream;
     access_log  logs/access.log  main;

     sendfile        on;
     keepalive_timeout  65;
     tcp_nopush	on;
     tcp_nodelay on;

     server {
         listen       80;
         server_name  localhost;

	location / {
		proxy_pass	http://127.0.0.1:8000/;
		proxy_redirect  off;

		proxy_set_header Host	$host;
		proxy_set_header X-Forwarded-For  $remote_addr;

		proxy_connect_timeout	90;
		proxy_send_timeout	90;
		proxy_read_timeout	90;

		proxy_buffer_size	4k;
		proxy_buffers		4 32k;
	}
     }
}

- --
Valentino Volonghi aka Dialtone
Now running MacOS X 10.5
Home Page: http://www.twisted.it
http://www.adroll.com

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Darwin)

iEYEARECAAYFAkmSOJkACgkQ9Llz28widGVoYwCghrR6kG2HbzYh9+j8336wnIM7
Dq8AoMyQrh6Q1JHyvvkrWJ8xDT2QiA02
=fuTi
-----END PGP SIGNATURE-----