Doing some investigation into what happened, apparently the memory just instantly got used, it wasn't leaking something slowly...any ideas?<div><br></div><div>Attached is an image of memory usage, then the consumer dies freeing up the memory used later.</div>
<div><div><br><div class="gmail_quote">On Tue, Sep 15, 2009 at 8:56 AM, Suhail Doshi <span dir="ltr"><<a href="mailto:suhail@mixpanel.com">suhail@mixpanel.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div>queue's are marked as durable and persistent on both sides:</div><div><br></div><div>Producer:</div><div><div>send_message(Channel, Ticket, X, RoutingKey, Payload) -></div><div>�� �BasicPublish = #'basic.publish'{ticket = Ticket,</div>
<div>�� � � � � � � � � � � � � � � � � �exchange = X,</div><div>�� � � � � � � � � � � � � � � � � �routing_key = RoutingKey,</div><div>�� � � � � � � � � � � � � � � � � �mandatory = false,</div><div>�� � � � � � � � � � � � � � � � � �immediate = false},</div>
<div>�� �BasicProperties = amqp_util:basic_properties(),</div><div>�� �Properties = BasicProperties#'P_basic'{delivery_mode=2}, %% Persistence plz</div><div>�� �Content = #content{class_id = 60,</div><div>�� � � � properties = Properties,</div>
<div>�� � � � properties_bin = none,</div><div>�� � � � payload_fragments_rev = [Payload]</div><div>�� � � �},</div><div>�� �amqp_channel:cast(Channel, BasicPublish, Content).</div></div><div><br></div><div><br></div>I recently just had my producer crash:<div>
<br></div><div><div>�� � � � � � � � � � � � � � � � � � <<"event">>,false,false})</div><div>Discarding content bearing method ({'basic.publish',1,<<"records">>,</div><div>
�� � � � � � � � � � � � � � � � � � � <<"event">>,false,false})</div><div>Discarding content bearing method ({'basic.publish',1,<<"records">>,</div><div>�� � � � � � � � � � � � � � � � � � � <<"event">>,false,false})</div>
<div>Discarding content bearing method ({'basic.publish',1,<<"records">>,</div><div>�� � � � � � � � � � � � � � � � � � � <<"event">>,false,false})</div><div>Discarding content bearing method ({'basic.publish',1,<<"records">>,</div>
<div>�� � � � � � � � � � � � � � � � � � � <<"event">>,false,false})</div><div>Discarding content bearing method ({'basic.publish',1,<<"records">>,</div><div>�� � � � � � � � � � � � � � � � � � � <<"event">>,false,false})</div>
<div>Discarding content bearing method ({'basic.publish',1,<<"records">>,</div><div>�� � � � � � � � � � � � � � � � � � � <<"event">>,false,false})</div><div><br></div>
<div>Crash dump was written to: erl_crash.dump</div><div>eheap_alloc: Cannot allocate 5854930744 bytes of memory (of type "heap_frag").</div><div>Aborted</div><div><br></div><div><br></div><div>Dump:</div><div>
<br>
</div><div><div>=erl_crash_dump:0.1</div><div>Tue Sep 15 11:12:02 2009</div><div>Slogan: eheap_alloc: Cannot allocate 5854930744 bytes of memory (of type "heap_frag").</div><div>System version: Erlang R13B01 (erts-5.7.2) [source] [64-bit] [smp:4:4] [rq:4] [async-threads:0] [hipe] [kernel-poll:false]</div>
<div>Compiled: Tue Jun 23 19:56:26 2009</div><div>Atoms: 7600</div><div>=memory</div><div>total: 7249076328</div><div>processes: 7195628192</div><div>processes_used: 7195558088</div><div>system: 53448136</div><div>atom: 509577</div>
<div>atom_used: 496634</div><div>binary: 43489256</div><div>code: 4768046</div><div>ets: 316624</div><div>=hash_table:atom_tab</div><div>size: 4813</div><div>used: 3785</div><div>objs: 7600</div><div>depth: 8</div><div>=index_table:atom_tab</div>
<div>size: 8192</div><div>limit: 1048576</div><div>entries: 7600</div><div>=hash_table:module_code</div><div>size: 97</div><div>used: 72</div><div>objs: 123</div><div>depth: 5</div><div>=index_table:module_code</div><div>
size: 1024</div><div>limit: 65536</div><div>entries: 123</div><div>=hash_table:export_list</div><div>size: 2411</div><div>used: 1798</div><div>objs: 3355</div><div>depth: 8</div><div>=index_table:export_list</div></div>
</div>
</blockquote></div><br><br clear="all"><br>-- <br><a href="http://mixpanel.com">http://mixpanel.com</a><br>Blog: <a href="http://blog.mixpanel.com">http://blog.mixpanel.com</a><br>
</div></div>