[rabbitmq-discuss] Writes to Rabbit Occasionally Hang Indefinitely

Jeff Doto jeffdoto at gmail.com
Mon Apr 28 21:04:31 BST 2014


 

Hello,

We have a distributed Java application talking to a clustered RabbitMQ 
instance, and we are encountering a situation where the message-producing 
Java client will occasionally hang indefinitely during queueing 
operations.  It is not the result of server memory limits being exceeded, 
or delays from flow control, as the management console displays both as 
healthy. 

Attached is the output of 'rabbitmqctl report' on the cluster nodes, and a 
Java thread stack.  Note the presence of the blocked threads attempting to 
write to Rabbit in the attached stack.  

Our application producer node is running RabbitMQ 3.1.3 Client through 
spring-rabbit 1.2.1.RELEASE, on CentOS release 5.6 (Final), Java(TM) SE 
Runtime Environment (build 1.6.0_45-b06).

Our application is configured to talk directly to the Rabbit server at the 
moment, though we have previously connected to the cluster through a 
hardware load balancer.  We see the same issue whether we connect directly, 
or through the load balancer.

We have the following RabbitMQ ConnectionFactory settings in our 
application:

requestedHeartbeat: 10 seconds

connectionTimeout: 60 seconds

This connectionFactory gets passed to a Spring CachingConnectionFactory 
with a channelCacheSize of 100.

Messages are being sent to the default exchange on an application-specific 
virtual host; the queues are direct queues with ha-mode:all set as a policy.

The application has a single master node with multiple threads writing to, 
and many consumer nodes, each with multiple threads consuming from the 
server.  We are queueing between 25 to 75 million messages a day.

We’re wondering if anyone has encountered an issue similar to this running 
the versions of Rabbit server / client we are.  Are there any suggestions 
for what we can do to prevent this?  Could upgrading the server version 
help?

Thank you,

Jeff
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20140428/771e4808/attachment.html>
-------------- next part --------------
{
		STATUS: 
{
		threads: 
[
		
{
		name: "1036158690 at qtp-783328245-6",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)"
		]
		},
		
{
		name: "122130810 at qtp-783328245-1",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)"
		]
		},
		
{
		name: "1313257738 at qtp-783328245-2",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)"
		]
		},
		
{
		name: "1437053119 at qtp-783328245-9 - Acceptor0 SelectChannelConnector at 0.0.0.0:9043",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)",
		"sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)",
		"sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)",
		"sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)",
		"sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)",
		"org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)",
		"org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)",
		"org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)",
		"org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)"
		]
		},
		
{
		name: "1613938021 at qtp-783328245-5",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)"
		]
		},
		
{
		name: "1681889006 at qtp-783328245-4",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.lang.Thread.dumpThreads(Native Method)",
		"java.lang.Thread.getAllStackTraces(Thread.java:1530)",
		"com.company.module.management.status.thread.ThreadStatusList.getThreads(ThreadStatusList.java:17)",
		"sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)",
		"sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)",
		"sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)",
		"java.lang.reflect.Method.invoke(Method.java:597)",
		"com.company.module.management.status.json.JSONObject.populateInternalMap(JSONObject.java:420)",
		"com.company.module.management.status.json.JSONObject.<init>(JSONObject.java:371)",
		"com.company.module.management.status.json.JSONObject.<init>(JSONObject.java:365)",
		"com.company.module.management.status.JsonReportFormatter.writeOutputForBean(JsonReportFormatter.java:60)",
		"com.company.module.management.status.ConfiguredBeanStatusReporter.writeOutputForBean(ConfiguredBeanStatusReporter.java:75)",
		"com.company.module.management.status.CompositeStatusReporter.writeOutputForBean(CompositeStatusReporter.java:76)",
		"com.company.module.management.status.StatusServlet.doGet(StatusServlet.java:183)",
		"javax.servlet.http.HttpServlet.service(HttpServlet.java:707)",
		"javax.servlet.http.HttpServlet.service(HttpServlet.java:820)",
		"org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)",
		"org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)",
		"org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)",
		"org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)",
		"org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)",
		"org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)",
		"org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)",
		"org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)",
		"org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)",
		"org.mortbay.jetty.Server.handle(Server.java:326)",
		"org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)",
		"org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)",
		"org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)",
		"org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)",
		"org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)",
		"org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)"
		]
		},
		
{
		name: "1851406627 at qtp-783328245-8 - Acceptor1 SelectChannelConnector at 0.0.0.0:9043",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)",
		"sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)",
		"sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)",
		"sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)",
		"sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)",
		"org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)",
		"org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)",
		"org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)",
		"org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)"
		]
		},
		
{
		name: "254300116 at qtp-783328245-3",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)"
		]
		},
		
{
		name: "532405576 at qtp-783328245-7",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)"
		]
		},
		
{
		name: "73152903 at qtp-783328245-0",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)"
		]
		},
		
{
		name: "AMQP Connection 172.20.149.41:5672",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"java.io.DataInputStream.readUnsignedByte(DataInputStream.java:271)",
		"com.rabbitmq.client.impl.Frame.readFrom(Frame.java:95)",
		"com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:131)",
		"com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:515)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-21",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-22",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-23",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-24",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-25",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-3",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-4",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-5",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-6",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "AsyncAppender-Worker-Thread-7",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:322)",
		"ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:225)"
		]
		},
		
{
		name: "Checkpointer (imageWebServicePerm_hraq257l)",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.sleepycat.je.utilint.DaemonThread.run(DaemonThread.java:172)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Cleaner-1 (imageWebServicePerm_hraq257l)",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.sleepycat.je.utilint.DaemonThread.run(DaemonThread.java:172)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Cluster Socket Accept",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.PlainSocketImpl.socketAccept(Native Method)",
		"java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)",
		"java.net.ServerSocket.implAccept(ServerSocket.java:462)",
		"java.net.ServerSocket.accept(ServerSocket.java:430)",
		"com.company.module.cluster.peer.socket.SocketPeerServer$Acceptor.run(SocketPeerServer.java:184)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "ClusterNode Master to Slave Monitor",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Thread.sleep(Native Method)",
		"com.company.contrib.web.cluster.MerlinClusterNode$Monitor.run(MerlinClusterNode.java:72)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "DestroyJavaVM",
		priority: 5,
		state: "RUNNABLE",
		trace: [ ]
		},
		
{
		name: "Finalizer",
		priority: 8,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)",
		"java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)",
		"java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171)"
		]
		},
		
{
		name: "Format client refresh timer",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.util.TimerThread.mainLoop(Timer.java:509)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "INCompressor (imageWebServicePerm_hraq257l)",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"com.sleepycat.je.utilint.DaemonThread.run(DaemonThread.java:174)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseTaskStatusService-getUnfinishedTasks 1",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseTaskStatusService-getUnfinishedTasks 2",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseTaskStatusService-getUnfinishedTasks 3",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseTaskStatusService-getUnfinishedTasks 4",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseTaskStatusService-getUnfinishedTasks 5",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-computeCandidateMainImages 36",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-computeCandidateMainImages 37",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-computeCandidateMainImages 38",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-computeCandidateMainImages 39",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-computeCandidateMainImages 40",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-getQueueSizeByServiceAndFunction 274",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-getQueueSizeByServiceAndFunction 275",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-getQueueSizeByServiceAndFunction 276",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-isMaster 1",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-isMaster 2",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-isMaster 3",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-isMaster 5",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-isMaster 6",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-isMaster 7",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-queueSize 1",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-queueSize 2",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-queueSize 3",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-queueSize 4",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-queueSize 5",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-updateMainImages 1",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-updateMainImages 2",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-updateMainImages 3",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-updateMainImages 4",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "InvokePhaseimage-updateMainImages 5",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:175)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.take(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:970)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "JMX server connection timeout 14497",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "MultiThreadedHttpConnectionManager cleanup",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)",
		"java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)",
		"org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)"
		]
		},
		
{
		name: "Multicast Heartbeat Receiver: imageWebService_merpocIngest",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.PlainDatagramSocketImpl.receive0(Native Method)",
		"java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:145)",
		"java.net.DatagramSocket.receive(DatagramSocket.java:725)",
		"com.company.module.cluster.heartbeat.multicast.MulticastHeartbeatReceiver$HeartbeatReceiverThread.run(MulticastHeartbeatReceiver.java:221)"
		]
		},
		
{
		name: "Multicast Heartbeat Sender: imageWebService_merpocIngest",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"com.company.module.cluster.heartbeat.multicast.MulticastHeartbeatSender$HeartbeatSenderThread.run(MulticastHeartbeatSender.java:274)"
		]
		},
		
{
		name: "Notification Client - DataServiceClient-MainImageType-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - DataServiceClient-MainImageType-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - DataServiceClient-MainImageType-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - DefaultImageCriteriaCacheManager:Entity-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - DefaultImageCriteriaCacheManager:Linear-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - DefaultImageCriteriaCacheManager:Menu-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [Album] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [ImageAssociation] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketOutputStream.socketWrite0(Native Method)",
		"java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)",
		"java.net.SocketOutputStream.write(SocketOutputStream.java:136)",
		"java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)",
		"java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)",
		"java.io.DataOutputStream.flush(DataOutputStream.java:106)",
		"com.rabbitmq.client.impl.SocketFrameHandler.flush(SocketFrameHandler.java:142)",
		"com.rabbitmq.client.impl.AMQConnection.flush(AMQConnection.java:488)",
		"com.rabbitmq.client.impl.AMQCommand.transmit(AMQCommand.java:125)",
		"com.rabbitmq.client.impl.AMQChannel.quiescingTransmit(AMQChannel.java:316)",
		"com.rabbitmq.client.impl.AMQChannel.transmit(AMQChannel.java:292)",
		"com.rabbitmq.client.impl.ChannelN.basicPublish(ChannelN.java:636)",
		"sun.reflect.GeneratedMethodAccessor118.invoke(Unknown Source)",
		"sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)",
		"java.lang.reflect.Method.invoke(Method.java:597)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$CachedChannelInvocationHandler.invoke(CachingConnectionFactory.java:348)",
		"com.sun.proxy.$Proxy50.basicPublish(Unknown Source)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.doSend(RabbitTemplate.java:675)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate$1.doInRabbit(RabbitTemplate.java:351)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.execute(RabbitTemplate.java:627)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:349)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:343)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:335)",
		"com.company.web.tv.image.impl.messaging.Producer.queueMessage(Producer.java:40)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueEntity(IterativeEntityProcessor.java:149)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueMitsForOriginalEntity(IterativeEntityProcessor.java:71)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueItemsForEntity(IterativeEntityProcessor.java:36)",
		"com.company.web.tv.image.impl.notifications.DataServiceNotificationProcessor.process(DataServiceNotificationProcessor.java:58)",
		"com.company.web.tv.image.impl.notifications.DataServiceNotificationProcessor.process(DataServiceNotificationProcessor.java:27)",
		"com.company.web.tv.image.impl.notifications.ImageWebServiceNotificationListener.receiveNotifications(ImageWebServiceNotificationListener.java:221)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1240)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [ImageAssociation] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [ImageAssociation] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [Media] NotificationListener-172.20.153.35",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:50)",
		"com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:65)",
		"com.rabbitmq.utility.BlockingCell.uninterruptibleGet(BlockingCell.java:111)",
		"com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:37)",
		"com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:349)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:569)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:501)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:494)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$CachedChannelInvocationHandler.physicalClose(CachingConnectionFactory.java:398)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$CachedChannelInvocationHandler.invoke(CachingConnectionFactory.java:331)",
		"com.sun.proxy.$Proxy50.close(Unknown Source)",
		"org.springframework.amqp.rabbit.connection.RabbitUtils.closeChannel(RabbitUtils.java:64)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.releaseResources(ConnectionFactoryUtils.java:151)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.execute(RabbitTemplate.java:634)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:349)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:343)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:335)",
		"com.company.web.tv.image.impl.messaging.Producer.queueMessage(Producer.java:40)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueEntity(IterativeEntityProcessor.java:149)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueChildren(IterativeEntityProcessor.java:123)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueMitsForChildren(IterativeEntityProcessor.java:62)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueItemsForEntity(IterativeEntityProcessor.java:39)",
		"com.company.web.tv.image.impl.notifications.DataServiceNotificationProcessor.process(DataServiceNotificationProcessor.java:58)",
		"com.company.web.tv.image.impl.notifications.DataServiceNotificationProcessor.process(DataServiceNotificationProcessor.java:27)",
		"com.company.web.tv.image.impl.notifications.ImageWebServiceNotificationListener.receiveNotifications(ImageWebServiceNotificationListener.java:221)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1240)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [Program] NotificationListener-172.20.153.35",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:50)",
		"com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:65)",
		"com.rabbitmq.utility.BlockingCell.uninterruptibleGet(BlockingCell.java:111)",
		"com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:37)",
		"com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:349)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:569)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:501)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:494)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$CachedChannelInvocationHandler.physicalClose(CachingConnectionFactory.java:398)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$CachedChannelInvocationHandler.invoke(CachingConnectionFactory.java:331)",
		"com.sun.proxy.$Proxy50.close(Unknown Source)",
		"org.springframework.amqp.rabbit.connection.RabbitUtils.closeChannel(RabbitUtils.java:64)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.releaseResources(ConnectionFactoryUtils.java:151)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.execute(RabbitTemplate.java:634)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:349)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:343)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:335)",
		"com.company.web.tv.image.impl.messaging.Producer.queueMessage(Producer.java:40)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueEntity(IterativeEntityProcessor.java:149)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueMitsForOriginalEntity(IterativeEntityProcessor.java:71)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueItemsForEntity(IterativeEntityProcessor.java:36)",
		"com.company.web.tv.image.impl.notifications.DataServiceNotificationProcessor.process(DataServiceNotificationProcessor.java:58)",
		"com.company.web.tv.image.impl.notifications.DataServiceNotificationProcessor.process(DataServiceNotificationProcessor.java:27)",
		"com.company.web.tv.image.impl.notifications.ImageWebServiceNotificationListener.receiveNotifications(ImageWebServiceNotificationListener.java:221)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1240)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [Song] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [SportsTeam] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [StationCompany] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [Station] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:250)",
		"org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)",
		"org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)",
		"java.io.FilterInputStream.read(FilterInputStream.java:116)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)",
		"java.io.FilterInputStream.read(FilterInputStream.java:90)",
		"org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextByte(JsonStreamReaderImpl.java:845)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.read(JsonStreamReaderImpl.java:826)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:786)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.scanToNext(JsonStreamReaderImpl.java:709)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.initialize(JsonStreamReaderImpl.java:100)",
		"com.company.data.api.marshalling.json.stream.JsonStreamReaderImpl.nextElement(JsonStreamReaderImpl.java:172)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshalNotifications(NotificationUnmarshaller.java:105)",
		"com.company.data.api.marshalling.notification.NotificationUnmarshaller.unmarshal(NotificationUnmarshaller.java:78)",
		"com.company.data.notification.api.client.NotificationClient$Poller.parsePayload(NotificationClient.java:1170)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1039)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Notification Client - [TagAssociation] NotificationListener-172.20.153.35",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"java.io.BufferedInputStream.fill(BufferedInputStream.java:218)",
		"java.io.BufferedInputStream.read(BufferedInputStream.java:237)",
		"org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)",
		"org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)",
		"org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)",
		"org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1413)",
		"org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)",
		"org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)",
		"org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)",
		"org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)",
		"org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)",
		"org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)",
		"org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)",
		"com.company.data.notification.api.client.NotificationClient$Poller.get(NotificationClient.java:1024)",
		"com.company.data.notification.api.client.NotificationClient$Poller.run(NotificationClient.java:988)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Peer Client //172.20.153.34:35631",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.company.module.cluster.peer.socket.SocketPeerClient$Writer.run(SocketPeerClient.java:251)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Peer Server Reader Socket[addr=/172.20.153.34,port=26135,localport=26080]",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.SocketInputStream.socketRead0(Native Method)",
		"java.net.SocketInputStream.read(SocketInputStream.java:129)",
		"com.company.module.cluster.peer.socket.ByteCountingInputStream.read(ByteCountingInputStream.java:67)",
		"java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2288)",
		"java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2301)",
		"java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2772)",
		"java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:778)",
		"java.io.ObjectInputStream.<init>(ObjectInputStream.java:278)",
		"com.company.module.cluster.peer.socket.Deserializer.readObjects(Deserializer.java:41)",
		"com.company.module.cluster.peer.socket.SocketPeerServer$Reader.run(SocketPeerServer.java:240)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "RMI Scheduler(0)",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "RMI TCP Accept-0",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.PlainSocketImpl.socketAccept(Native Method)",
		"java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)",
		"java.net.ServerSocket.implAccept(ServerSocket.java:462)",
		"java.net.ServerSocket.accept(ServerSocket.java:430)",
		"sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)",
		"sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)",
		"sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "RMI TCP Accept-0",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.PlainSocketImpl.socketAccept(Native Method)",
		"java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)",
		"java.net.ServerSocket.implAccept(ServerSocket.java:462)",
		"java.net.ServerSocket.accept(ServerSocket.java:430)",
		"sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)",
		"sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "RMI TCP Accept-9243",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.PlainSocketImpl.socketAccept(Native Method)",
		"java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)",
		"java.net.ServerSocket.implAccept(ServerSocket.java:462)",
		"java.net.ServerSocket.accept(ServerSocket.java:430)",
		"sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)",
		"sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "RMI TCP Connection(idle)",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)",
		"java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)",
		"java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "RMI TCP Connection(idle)",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)",
		"java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)",
		"java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:955)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "Reference Handler",
		priority: 10,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)"
		]
		},
		
{
		name: "Signal Dispatcher",
		priority: 9,
		state: "RUNNABLE",
		trace: [ ]
		},
		
{
		name: "StopMonitor",
		priority: 5,
		state: "RUNNABLE",
		trace: 
[
		"java.net.PlainSocketImpl.socketAccept(Native Method)",
		"java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)",
		"java.net.ServerSocket.implAccept(ServerSocket.java:462)",
		"java.net.ServerSocket.accept(ServerSocket.java:430)",
		"org.mortbay.start.Monitor.run(Monitor.java:81)"
		]
		},
		
{
		name: "TaskManager Scheduler",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"com.company.contrib.tasks.impl.TaskManagerImpl$SchedulerThread.run(TaskManagerImpl.java:597)"
		]
		},
		
{
		name: "Thread-39",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Thread.sleep(Native Method)",
		"com.company.module.management.status.alive.ThreadedCachingAliveChecker$AliveCheckerThread.run(ThreadedCachingAliveChecker.java:109)"
		]
		},
		
{
		name: "Timer-1",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.util.TimerThread.mainLoop(Timer.java:509)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "Timer-2",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.util.TimerThread.mainLoop(Timer.java:509)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "Timer-3",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.util.TimerThread.mainLoop(Timer.java:509)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "Timer-4",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.util.TimerThread.mainLoop(Timer.java:509)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "Timer-5",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.util.TimerThread.mainLoop(Timer.java:509)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "Timer-6",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.util.TimerThread.mainLoop(Timer.java:509)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "Timer-7",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.util.TimerThread.mainLoop(Timer.java:509)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "authorize 1",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 10",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 2",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 3",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 4",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 5",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 6",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 7",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 8",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "authorize 9",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "dtautosensor",
		priority: 5,
		state: "RUNNABLE",
		trace: [ ]
		},
		
{
		name: "dtcontroller",
		priority: 5,
		state: "RUNNABLE",
		trace: [ ]
		},
		
{
		name: "dtmetricstimer",
		priority: 5,
		state: "RUNNABLE",
		trace: [ ]
		},
		
{
		name: "marshall 179",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 184",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 192",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 193",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 200",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 201",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 202",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 203",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 204",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "marshall 205",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "messageStoreTaskScheduler-1",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "messageStoreTaskScheduler-1",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "net.sf.ehcache.CacheManager at 13e4318d",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"java.util.TimerThread.mainLoop(Timer.java:483)",
		"java.util.TimerThread.run(Timer.java:462)"
		]
		},
		
{
		name: "pool-1-thread-1",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-10-thread-1",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-10-thread-2",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-10-thread-3",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-10-thread-4",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-10-thread-5",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)",
		"java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-11-thread-1",
		priority: 5,
		state: "BLOCKED",
		trace: 
[
		"com.rabbitmq.client.impl.SocketFrameHandler.writeFrame(SocketFrameHandler.java:136)",
		"com.rabbitmq.client.impl.HeartbeatSender$HeartbeatRunnable.run(HeartbeatSender.java:133)",
		"java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)",
		"java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)",
		"java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-105",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)",
		"java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)",
		"com.company.contrib.tasks.impl.RunnableWrapper.await(RunnableWrapper.java:349)",
		"com.company.contrib.tasks.impl.RunnableWrapper$ContextImpl.waitForRunningSubTasks(RunnableWrapper.java:600)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesListTask.run(UpdateMainImagesListTask.java:41)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-106",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:50)",
		"com.rabbitmq.utility.BlockingCell.uninterruptibleGet(BlockingCell.java:89)",
		"com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:33)",
		"com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:343)",
		"com.rabbitmq.client.impl.AMQChannel.privateRpc(AMQChannel.java:216)",
		"com.rabbitmq.client.impl.AMQChannel.exnWrappingRpc(AMQChannel.java:118)",
		"com.rabbitmq.client.impl.ChannelN.open(ChannelN.java:125)",
		"com.rabbitmq.client.impl.ChannelManager.createChannel(ChannelManager.java:121)",
		"com.rabbitmq.client.impl.AMQConnection.createChannel(AMQConnection.java:473)",
		"org.springframework.amqp.rabbit.connection.SimpleConnection.createChannel(SimpleConnection.java:42)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.createBareChannel(CachingConnectionFactory.java:416)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.access$000(CachingConnectionFactory.java:407)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.createBareChannel(CachingConnectionFactory.java:209)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.getCachedChannelProxy(CachingConnectionFactory.java:186)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.getChannel(CachingConnectionFactory.java:180)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.access$300(CachingConnectionFactory.java:52)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.createChannel(CachingConnectionFactory.java:420)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils$1.createChannel(ConnectionFactoryUtils.java:81)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.doGetTransactionalResourceHolder(ConnectionFactoryUtils.java:129)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.getTransactionalResourceHolder(ConnectionFactoryUtils.java:67)",
		"org.springframework.amqp.rabbit.connection.RabbitAccessor.getTransactionalResourceHolder(RabbitAccessor.java:102)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.execute(RabbitTemplate.java:618)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:349)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:343)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:335)",
		"com.company.web.tv.image.impl.messaging.Producer.queueMessage(Producer.java:40)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueEntity(IterativeEntityProcessor.java:149)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueMitsForOriginalEntity(IterativeEntityProcessor.java:71)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueItemsForEntity(IterativeEntityProcessor.java:36)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.queueEntity(UpdateMainImagesForAllMainImageTypesTask.java:63)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.run(UpdateMainImagesForAllMainImageTypesTask.java:39)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-107",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)",
		"java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)",
		"com.company.contrib.tasks.impl.RunnableWrapper.await(RunnableWrapper.java:349)",
		"com.company.contrib.tasks.impl.RunnableWrapper$ContextImpl.waitForRunningSubTasks(RunnableWrapper.java:600)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesListTask.run(UpdateMainImagesListTask.java:41)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-108",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:50)",
		"com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:65)",
		"com.rabbitmq.utility.BlockingCell.uninterruptibleGet(BlockingCell.java:111)",
		"com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:37)",
		"com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:349)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:569)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:501)",
		"com.rabbitmq.client.impl.ChannelN.close(ChannelN.java:494)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$CachedChannelInvocationHandler.physicalClose(CachingConnectionFactory.java:398)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$CachedChannelInvocationHandler.invoke(CachingConnectionFactory.java:331)",
		"com.sun.proxy.$Proxy50.close(Unknown Source)",
		"org.springframework.amqp.rabbit.connection.RabbitUtils.closeChannel(RabbitUtils.java:64)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.releaseResources(ConnectionFactoryUtils.java:151)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.execute(RabbitTemplate.java:634)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:349)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:343)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:335)",
		"com.company.web.tv.image.impl.messaging.Producer.queueMessage(Producer.java:40)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueEntity(IterativeEntityProcessor.java:149)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueMitsForOriginalEntity(IterativeEntityProcessor.java:71)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueItemsForEntity(IterativeEntityProcessor.java:36)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.queueEntity(UpdateMainImagesForAllMainImageTypesTask.java:63)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.run(UpdateMainImagesForAllMainImageTypesTask.java:39)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-111",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)",
		"java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)",
		"com.company.contrib.tasks.impl.RunnableWrapper.await(RunnableWrapper.java:349)",
		"com.company.contrib.tasks.impl.RunnableWrapper$ContextImpl.waitForRunningSubTasks(RunnableWrapper.java:600)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesListTask.run(UpdateMainImagesListTask.java:41)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-112",
		priority: 5,
		state: "WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:485)",
		"com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:50)",
		"com.rabbitmq.utility.BlockingCell.uninterruptibleGet(BlockingCell.java:89)",
		"com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:33)",
		"com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:343)",
		"com.rabbitmq.client.impl.AMQChannel.privateRpc(AMQChannel.java:216)",
		"com.rabbitmq.client.impl.AMQChannel.exnWrappingRpc(AMQChannel.java:118)",
		"com.rabbitmq.client.impl.ChannelN.open(ChannelN.java:125)",
		"com.rabbitmq.client.impl.ChannelManager.createChannel(ChannelManager.java:121)",
		"com.rabbitmq.client.impl.AMQConnection.createChannel(AMQConnection.java:473)",
		"org.springframework.amqp.rabbit.connection.SimpleConnection.createChannel(SimpleConnection.java:42)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.createBareChannel(CachingConnectionFactory.java:416)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.access$000(CachingConnectionFactory.java:407)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.createBareChannel(CachingConnectionFactory.java:209)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.getCachedChannelProxy(CachingConnectionFactory.java:186)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.getChannel(CachingConnectionFactory.java:180)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.access$300(CachingConnectionFactory.java:52)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.createChannel(CachingConnectionFactory.java:420)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils$1.createChannel(ConnectionFactoryUtils.java:81)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.doGetTransactionalResourceHolder(ConnectionFactoryUtils.java:129)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.getTransactionalResourceHolder(ConnectionFactoryUtils.java:67)",
		"org.springframework.amqp.rabbit.connection.RabbitAccessor.getTransactionalResourceHolder(RabbitAccessor.java:102)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.execute(RabbitTemplate.java:618)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:349)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:343)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:335)",
		"com.company.web.tv.image.impl.messaging.Producer.queueMessage(Producer.java:40)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueEntity(IterativeEntityProcessor.java:149)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueMitsForOriginalEntity(IterativeEntityProcessor.java:71)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueItemsForEntity(IterativeEntityProcessor.java:36)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.queueEntity(UpdateMainImagesForAllMainImageTypesTask.java:63)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.run(UpdateMainImagesForAllMainImageTypesTask.java:39)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-113",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)",
		"java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)",
		"com.company.contrib.tasks.impl.RunnableWrapper.await(RunnableWrapper.java:349)",
		"com.company.contrib.tasks.impl.RunnableWrapper$ContextImpl.waitForRunningSubTasks(RunnableWrapper.java:600)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesListTask.run(UpdateMainImagesListTask.java:41)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-114",
		priority: 5,
		state: "BLOCKED",
		trace: 
[
		"java.io.BufferedOutputStream.write(BufferedOutputStream.java)",
		"java.io.DataOutputStream.writeByte(DataOutputStream.java:136)",
		"com.rabbitmq.client.impl.Frame.writeTo(Frame.java:189)",
		"com.rabbitmq.client.impl.SocketFrameHandler.writeFrame(SocketFrameHandler.java:137)",
		"com.rabbitmq.client.impl.AMQConnection.writeFrame(AMQConnection.java:480)",
		"com.rabbitmq.client.impl.AMQCommand.transmit(AMQCommand.java:102)",
		"com.rabbitmq.client.impl.AMQChannel.quiescingTransmit(AMQChannel.java:316)",
		"com.rabbitmq.client.impl.AMQChannel.quiescingTransmit(AMQChannel.java:298)",
		"com.rabbitmq.client.impl.AMQChannel.quiescingRpc(AMQChannel.java:233)",
		"com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:224)",
		"com.rabbitmq.client.impl.AMQChannel.privateRpc(AMQChannel.java:209)",
		"com.rabbitmq.client.impl.AMQChannel.exnWrappingRpc(AMQChannel.java:118)",
		"com.rabbitmq.client.impl.ChannelN.open(ChannelN.java:125)",
		"com.rabbitmq.client.impl.ChannelManager.createChannel(ChannelManager.java:121)",
		"com.rabbitmq.client.impl.AMQConnection.createChannel(AMQConnection.java:473)",
		"org.springframework.amqp.rabbit.connection.SimpleConnection.createChannel(SimpleConnection.java:42)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.createBareChannel(CachingConnectionFactory.java:416)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.access$000(CachingConnectionFactory.java:407)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.createBareChannel(CachingConnectionFactory.java:209)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.getCachedChannelProxy(CachingConnectionFactory.java:186)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.getChannel(CachingConnectionFactory.java:180)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.access$300(CachingConnectionFactory.java:52)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.createChannel(CachingConnectionFactory.java:420)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils$1.createChannel(ConnectionFactoryUtils.java:81)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.doGetTransactionalResourceHolder(ConnectionFactoryUtils.java:129)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.getTransactionalResourceHolder(ConnectionFactoryUtils.java:67)",
		"org.springframework.amqp.rabbit.connection.RabbitAccessor.getTransactionalResourceHolder(RabbitAccessor.java:102)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.execute(RabbitTemplate.java:618)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:349)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:343)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:335)",
		"com.company.web.tv.image.impl.messaging.Producer.queueMessage(Producer.java:40)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueEntity(IterativeEntityProcessor.java:149)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueMitsForOriginalEntity(IterativeEntityProcessor.java:71)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueItemsForEntity(IterativeEntityProcessor.java:36)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.queueEntity(UpdateMainImagesForAllMainImageTypesTask.java:63)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.run(UpdateMainImagesForAllMainImageTypesTask.java:39)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-115",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)",
		"java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)",
		"com.company.contrib.tasks.impl.RunnableWrapper.await(RunnableWrapper.java:349)",
		"com.company.contrib.tasks.impl.RunnableWrapper$ContextImpl.waitForRunningSubTasks(RunnableWrapper.java:600)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesListTask.run(UpdateMainImagesListTask.java:41)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "pool-4-thread-116",
		priority: 5,
		state: "BLOCKED",
		trace: 
[
		"com.rabbitmq.client.impl.SocketFrameHandler.writeFrame(SocketFrameHandler.java:136)",
		"com.rabbitmq.client.impl.AMQConnection.writeFrame(AMQConnection.java:480)",
		"com.rabbitmq.client.impl.AMQCommand.transmit(AMQCommand.java:102)",
		"com.rabbitmq.client.impl.AMQChannel.quiescingTransmit(AMQChannel.java:316)",
		"com.rabbitmq.client.impl.AMQChannel.quiescingTransmit(AMQChannel.java:298)",
		"com.rabbitmq.client.impl.AMQChannel.quiescingRpc(AMQChannel.java:233)",
		"com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:224)",
		"com.rabbitmq.client.impl.AMQChannel.privateRpc(AMQChannel.java:209)",
		"com.rabbitmq.client.impl.AMQChannel.exnWrappingRpc(AMQChannel.java:118)",
		"com.rabbitmq.client.impl.ChannelN.open(ChannelN.java:125)",
		"com.rabbitmq.client.impl.ChannelManager.createChannel(ChannelManager.java:121)",
		"com.rabbitmq.client.impl.AMQConnection.createChannel(AMQConnection.java:473)",
		"org.springframework.amqp.rabbit.connection.SimpleConnection.createChannel(SimpleConnection.java:42)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.createBareChannel(CachingConnectionFactory.java:416)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.access$000(CachingConnectionFactory.java:407)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.createBareChannel(CachingConnectionFactory.java:209)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.getCachedChannelProxy(CachingConnectionFactory.java:186)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.getChannel(CachingConnectionFactory.java:180)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory.access$300(CachingConnectionFactory.java:52)",
		"org.springframework.amqp.rabbit.connection.CachingConnectionFactory$ChannelCachingConnectionProxy.createChannel(CachingConnectionFactory.java:420)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils$1.createChannel(ConnectionFactoryUtils.java:81)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.doGetTransactionalResourceHolder(ConnectionFactoryUtils.java:129)",
		"org.springframework.amqp.rabbit.connection.ConnectionFactoryUtils.getTransactionalResourceHolder(ConnectionFactoryUtils.java:67)",
		"org.springframework.amqp.rabbit.connection.RabbitAccessor.getTransactionalResourceHolder(RabbitAccessor.java:102)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.execute(RabbitTemplate.java:618)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:349)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:343)",
		"org.springframework.amqp.rabbit.core.RabbitTemplate.send(RabbitTemplate.java:335)",
		"com.company.web.tv.image.impl.messaging.Producer.queueMessage(Producer.java:40)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueEntity(IterativeEntityProcessor.java:149)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueMitsForOriginalEntity(IterativeEntityProcessor.java:71)",
		"com.company.web.tv.image.impl.util.IterativeEntityProcessor.queueItemsForEntity(IterativeEntityProcessor.java:36)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.queueEntity(UpdateMainImagesForAllMainImageTypesTask.java:63)",
		"com.company.web.tv.image.impl.task.producer.UpdateMainImagesForAllMainImageTypesTask.run(UpdateMainImagesForAllMainImageTypesTask.java:39)",
		"com.company.contrib.tasks.impl.RunnableWrapper.run(RunnableWrapper.java:97)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-1",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-10",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-2",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-3",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-4",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-5",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-6",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-7",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-8",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "task-scheduler-9",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"sun.misc.Unsafe.park(Native Method)",
		"java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)",
		"java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)",
		"java.util.concurrent.DelayQueue.take(DelayQueue.java:164)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)",
		"java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)",
		"java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)",
		"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 165",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 166",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 168",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 170",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 171",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 173",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 174",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 175",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 176",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		},
		
{
		name: "unmarshall 177",
		priority: 5,
		state: "TIMED_WAITING",
		trace: 
[
		"java.lang.Object.wait(Native Method)",
		"java.lang.Object.wait(Object.java:443)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:199)",
		"com.company.module.pipeline.queue.EquitableBlockingQueue.poll(EquitableBlockingQueue.java:38)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:968)",
		"com.company.module.pipeline.thread.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:930)",
		"java.lang.Thread.run(Thread.java:662)"
		]
		}
		]
		}
}
-------------- next part --------------
$ cat /etc/redhat-release 
CentOS release 6.5 (Final)

$ rpm -qa | grep -e rabbit -e erlang
rabbitmq-server-3.2.2-1.noarch
esl-erlang-R16B03-3.x86_64
vmware-tools-plugins-grabbitmqProxy-9.4.5-1.el6.x86_64


Reporting server status on {{2014,4,28},{17,3,45}}

 ...
Status of node 'rabbit at ccpmer-po-cb176-p' ...
[{pid,18776},
 {running_applications,
     [{rabbitmq_management_visualiser,"RabbitMQ Visualiser","3.2.2"},
      {rabbitmq_management,"RabbitMQ Management Console","3.2.2"},
      {rabbitmq_web_dispatch,"RabbitMQ Web Dispatcher","3.2.2"},
      {webmachine,"webmachine","1.10.3-rmq3.2.2-gite9359c7"},
      {mochiweb,"MochiMedia Web Server","2.7.0-rmq3.2.2-git680dba8"},
      {rabbitmq_management_agent,"RabbitMQ Management Agent","3.2.2"},
      {rabbit,"RabbitMQ","3.2.2"},
      {os_mon,"CPO  CXC 138 46","2.2.14"},
      {inets,"INETS  CXC 138 49","5.9.7"},
      {mnesia,"MNESIA  CXC 138 12","4.11"},
      {amqp_client,"RabbitMQ AMQP Client","3.2.2"},
      {xmerl,"XML parser","1.3.5"},
      {sasl,"SASL  CXC 138 11","2.3.4"},
      {stdlib,"ERTS  CXC 138 10","1.19.4"},
      {kernel,"ERTS  CXC 138 10","2.16.4"}]},
 {os,{unix,linux}},
 {erlang_version,
     "Erlang R16B03 (erts-5.10.4) [source] [64-bit] [smp:2:2] [async-threads:30] [hipe] [kernel-poll:true]\n"},
 {memory,
     [{total,89450216},
      {connection_procs,8822888},
      {queue_procs,1948648},
      {plugins,1031840},
      {other_proc,14366152},
      {mnesia,291528},
      {mgmt_db,5768400},
      {msg_index,1269048},
      {other_ets,6624968},
      {binary,5845976},
      {code,19745928},
      {atom,703377},
      {other_system,23031463}]},
 {vm_memory_high_watermark,0.8},
 {vm_memory_limit,13380295065},
 {disk_free_limit,50000000},
 {disk_free,29098586112},
 {file_descriptors,
     [{total_limit,219900},
      {total_used,55},
      {sockets_limit,197908},
      {sockets_used,13}]},
 {processes,[{limit,1048576},{used,1831}]},
 {run_queue,0},
 {uptime,4650735}]

Cluster status of node 'rabbit at ccpmer-po-cb176-p' ...
[{nodes,[{disc,['rabbit at ccpmer-po-cb176-p','rabbit at ccpmer-po-cb177-p']}]},
 {running_nodes,['rabbit at ccpmer-po-cb177-p','rabbit at ccpmer-po-cb176-p']},
 {partitions,[]}]

Application environment of node 'rabbit at ccpmer-po-cb176-p' ...
[{auth_backends,[rabbit_auth_backend_internal]},
 {auth_mechanisms,['PLAIN','AMQPLAIN']},
 {backing_queue_module,rabbit_variable_queue},
 {cluster_nodes,{['ccpmer-po-cb102-p','ccpmer-po-cb103-p','ccpmer-po-cb176-p'],
                 disc}},
 {cluster_partition_handling,ignore},
 {collect_statistics,fine},
 {collect_statistics_interval,5000},
 {default_permissions,[<<".*">>,<<".*">>,<<".*">>]},
 {default_user,<<"guest">>},
 {default_user_tags,[administrator]},
 {default_vhost,<<"/">>},
 {delegate_count,16},
 {disk_free_limit,50000000},
 {enabled_plugins_file,"/etc/rabbitmq/enabled_plugins"},
 {error_logger,{file,"/var/log/rabbitmq/rabbit at ccpmer-po-cb176-p.log"}},
 {frame_max,131072},
 {halt_on_upgrade_failure,true},
 {heartbeat,580},
 {hipe_compile,false},
 {hipe_modules,[rabbit_reader,rabbit_channel,gen_server2,rabbit_exchange,
                rabbit_command_assembler,rabbit_framing_amqp_0_9_1,
                rabbit_basic,rabbit_event,lists,queue,priority_queue,
                rabbit_router,rabbit_trace,rabbit_misc,rabbit_binary_parser,
                rabbit_exchange_type_direct,rabbit_guid,rabbit_net,
                rabbit_amqqueue_process,rabbit_variable_queue,
                rabbit_binary_generator,rabbit_writer,delegate,gb_sets,lqueue,
                sets,orddict,rabbit_amqqueue,rabbit_limiter,gb_trees,
                rabbit_queue_index,rabbit_exchange_decorator,gen,dict,ordsets,
                file_handle_cache,rabbit_msg_store,array,
                rabbit_msg_store_ets_index,rabbit_msg_file,
                rabbit_exchange_type_fanout,rabbit_exchange_type_topic,mnesia,
                mnesia_lib,rpc,mnesia_tm,qlc,sofs,proplists,credit_flow,pmon,
                ssl_connection,tls_connection,ssl_record,tls_record,gen_fsm,
                ssl]},
 {included_applications,[]},
 {log_levels,[{connection,info}]},
 {msg_store_file_size_limit,16777216},
 {msg_store_index_module,rabbit_msg_store_ets_index},
 {plugins_dir,"/usr/lib/rabbitmq/lib/rabbitmq_server-3.2.2/sbin/../plugins"},
 {plugins_expand_dir,"/var/lib/rabbitmq/mnesia/rabbit at ccpmer-po-cb176-p-plugins-expand"},
 {queue_index_max_journal_entries,65536},
 {reverse_dns_lookups,false},
 {sasl_error_logger,{file,"/var/log/rabbitmq/rabbit at ccpmer-po-cb176-p-sasl.log"}},
 {server_properties,[]},
 {ssl_apps,[asn1,crypto,public_key,ssl]},
 {ssl_cert_login_from,distinguished_name},
 {ssl_listeners,[]},
 {ssl_options,[]},
 {tcp_listen_options,[binary,
                      {packet,raw},
                      {reuseaddr,true},
                      {backlog,128},
                      {nodelay,true},
                      {linger,{true,0}},
                      {exit_on_close,false}]},
 {tcp_listeners,[5672]},
 {trace_vhosts,[]},
 {vm_memory_high_watermark,0.8},
 {vm_memory_high_watermark_paging_ratio,0.5}]

Status of node 'rabbit at ccpmer-po-cb177-p' ...
[{pid,4882},
 {running_applications,
     [{rabbitmq_management_visualiser,"RabbitMQ Visualiser","3.2.2"},
      {rabbitmq_management,"RabbitMQ Management Console","3.2.2"},
      {rabbitmq_web_dispatch,"RabbitMQ Web Dispatcher","3.2.2"},
      {webmachine,"webmachine","1.10.3-rmq3.2.2-gite9359c7"},
      {mochiweb,"MochiMedia Web Server","2.7.0-rmq3.2.2-git680dba8"},
      {rabbitmq_management_agent,"RabbitMQ Management Agent","3.2.2"},
      {rabbit,"RabbitMQ","3.2.2"},
      {os_mon,"CPO  CXC 138 46","2.2.14"},
      {mnesia,"MNESIA  CXC 138 12","4.11"},
      {amqp_client,"RabbitMQ AMQP Client","3.2.2"},
      {inets,"INETS  CXC 138 49","5.9.7"},
      {xmerl,"XML parser","1.3.5"},
      {sasl,"SASL  CXC 138 11","2.3.4"},
      {stdlib,"ERTS  CXC 138 10","1.19.4"},
      {kernel,"ERTS  CXC 138 10","2.16.4"}]},
 {os,{unix,linux}},
 {erlang_version,
     "Erlang R16B03 (erts-5.10.4) [source] [64-bit] [smp:2:2] [async-threads:30] [hipe] [kernel-poll:true]\n"},
 {memory,
     [{total,104229600},
      {connection_procs,1685248},
      {queue_procs,1781608},
      {plugins,1212960},
      {other_proc,14832136},
      {mnesia,291472},
      {mgmt_db,11352},
      {msg_index,6131472},
      {other_ets,27521256},
      {binary,7630456},
      {code,19736328},
      {atom,703377},
      {other_system,22691935}]},
 {vm_memory_high_watermark,0.8},
 {vm_memory_limit,13380295065},
 {disk_free_limit,50000000},
 {disk_free,29138169856},
 {file_descriptors,
     [{total_limit,219900},
      {total_used,42},
      {sockets_limit,197908},
      {sockets_used,5}]},
 {processes,[{limit,1048576},{used,588}]},
 {run_queue,0},
 {uptime,4575908}]

Cluster status of node 'rabbit at ccpmer-po-cb177-p' ...
[{nodes,[{disc,['rabbit at ccpmer-po-cb176-p','rabbit at ccpmer-po-cb177-p']}]},
 {running_nodes,['rabbit at ccpmer-po-cb176-p','rabbit at ccpmer-po-cb177-p']},
 {partitions,[]}]

Application environment of node 'rabbit at ccpmer-po-cb177-p' ...
[{auth_backends,[rabbit_auth_backend_internal]},
 {auth_mechanisms,['PLAIN','AMQPLAIN']},
 {backing_queue_module,rabbit_variable_queue},
 {cluster_nodes,{['ccpmer-po-cb102-p','ccpmer-po-cb103-p','ccpmer-po-cb176-p',
                  'ccpmer-po-cb177-p'],
                 disc}},
 {cluster_partition_handling,ignore},
 {collect_statistics,fine},
 {collect_statistics_interval,5000},
 {default_permissions,[<<".*">>,<<".*">>,<<".*">>]},
 {default_user,<<"guest">>},
 {default_user_tags,[administrator]},
 {default_vhost,<<"/">>},
 {delegate_count,16},
 {disk_free_limit,50000000},
 {enabled_plugins_file,"/etc/rabbitmq/enabled_plugins"},
 {error_logger,{file,"/var/log/rabbitmq/rabbit at ccpmer-po-cb177-p.log"}},
 {frame_max,131072},
 {halt_on_upgrade_failure,true},
 {heartbeat,580},
 {hipe_compile,false},
 {hipe_modules,[rabbit_reader,rabbit_channel,gen_server2,rabbit_exchange,
                rabbit_command_assembler,rabbit_framing_amqp_0_9_1,
                rabbit_basic,rabbit_event,lists,queue,priority_queue,
                rabbit_router,rabbit_trace,rabbit_misc,rabbit_binary_parser,
                rabbit_exchange_type_direct,rabbit_guid,rabbit_net,
                rabbit_amqqueue_process,rabbit_variable_queue,
                rabbit_binary_generator,rabbit_writer,delegate,gb_sets,lqueue,
                sets,orddict,rabbit_amqqueue,rabbit_limiter,gb_trees,
                rabbit_queue_index,rabbit_exchange_decorator,gen,dict,ordsets,
                file_handle_cache,rabbit_msg_store,array,
                rabbit_msg_store_ets_index,rabbit_msg_file,
                rabbit_exchange_type_fanout,rabbit_exchange_type_topic,mnesia,
                mnesia_lib,rpc,mnesia_tm,qlc,sofs,proplists,credit_flow,pmon,
                ssl_connection,tls_connection,ssl_record,tls_record,gen_fsm,
                ssl]},
 {included_applications,[]},
 {log_levels,[{connection,info}]},
 {msg_store_file_size_limit,16777216},
 {msg_store_index_module,rabbit_msg_store_ets_index},
 {plugins_dir,"/usr/lib/rabbitmq/lib/rabbitmq_server-3.2.2/sbin/../plugins"},
 {plugins_expand_dir,"/var/lib/rabbitmq/mnesia/rabbit at ccpmer-po-cb177-p-plugins-expand"},
 {queue_index_max_journal_entries,65536},
 {reverse_dns_lookups,false},
 {sasl_error_logger,{file,"/var/log/rabbitmq/rabbit at ccpmer-po-cb177-p-sasl.log"}},
 {server_properties,[]},
 {ssl_apps,[asn1,crypto,public_key,ssl]},
 {ssl_cert_login_from,distinguished_name},
 {ssl_listeners,[]},
 {ssl_options,[]},
 {tcp_listen_options,[binary,
                      {packet,raw},
                      {reuseaddr,true},
                      {backlog,128},
                      {nodelay,true},
                      {linger,{true,0}},
                      {exit_on_close,false}]},
 {tcp_listeners,[5672]},
 {trace_vhosts,[]},
 {vm_memory_high_watermark,0.8},
 {vm_memory_high_watermark_paging_ratio,0.5}]



More information about the rabbitmq-discuss mailing list