Hi<div>I'm trying performance testing with RabbitMQ for my scenario. And getting into this state where RabbitMQ is not responding. </div><div>My scenario is like this:</div><div>a- Trigger process gets some minimal information to process..This gets almost say a million plus such information.</div>
<div>b- it then puts this on this information in 20queues []. The consumers for each of these then get the detail for the information passed to them.</div><div>c- After the detail fetch and necessary transformation, the content is then passed on to further queue for processing. there is one processing queue corresponding to </div>
<div> each queue in (b).</div><div><br></div><div>So in total i'm running 20 + 20= 40 queues. </div><div>The situation that i'm running into is like this:</div><div>After processing some entries[random count], suddenly there is no activity in RabbitMQ. If i kill one of the consumer, then some activity happens and other queues process for some time.Then again it repeats and i kill some other consumer. Finally killing all the consumers.</div>
<div>If i restart all consumers again things work for some time before showing the same inaction behavior. </div><div><br></div><div>During the whole processing i never noticed CPU usage to go beyond 60% or memory causing any issues. The Rabbit MQ overview states that it is not even using 2% of available Erlang processes. And it also states that it is not even using 20% of available memory.</div>
<div><br></div><div>I also could not relate it to DB level locking for my application. The reason being when the rabbitmq stopped responding, i launched other process [not using queues] and do the similar action on DB and that went fine.</div>
<div><br></div><div>To eliminate any issues due to Exchange share among the multiple queues, i also tried creating 40 different exchanges and binding each to one & one exchange only :( .</div><div>But still facing the same issues. </div>
<div><br></div><div><div>I'm running it [rabbitmq2.1.1] on windows 2003 server and using java client to publish and consume message from rabbitmq. </div></div><div><br></div><div>At no time i see any rabbitmq or erlang related error or crash. </div>
<div><br></div><div>Some thing that i noticed for the first time, there are lots of connection and channels each listening to some port [not specified by the application code]. Seems to be created by RabbitMQ. </div><div>
<br></div><div>Any suggestion or remedy for my scenario.</div><div><br></div><div>thanks</div><div>pradeep</div>