[jira] [Created] (IGNITE-1616) Cache.get() hangs in transaction after lots of server nodes restarts

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (IGNITE-1616) Cache.get() hangs in transaction after lots of server nodes restarts

Anton Vinogradov (Jira)
Artem Shutak created IGNITE-1616:
------------------------------------

             Summary: Cache.get() hangs in transaction after lots of server nodes restarts
                 Key: IGNITE-1616
                 URL: https://issues.apache.org/jira/browse/IGNITE-1616
             Project: Ignite
          Issue Type: Bug
            Reporter: Artem Shutak
            Assignee: Semen Boikov
             Fix For: ignite-1.5


In process of working on IGNITE-1397 (Load/consistency test framework) I've faced with a hanging of IgniteCache.get() in transaction.

Configuration:
- 1 client node
- 2 server nodes
- duration - 10 hours
- one random server node is killed every 10 min and after 2 minutes started again

h5. "Transactional write/read consistency" test description:
Each client generates a random integer K in a limited range (say, [0, 100000]) and creates 5 (may be configured) keys in the form 'key-' + K + '-1', 'key-' + K + '-2', ... Then client starts a pessimistic repeatable read transaction, reads value associated with each key. Values must be equal. Client increments value by 1, commits the transaction. Client should retry in the case of topology exceptions possibly thrown from cache operations.

After ~2,5 hours 64 threads of client node stopped all activity and hanged on Cache.get().

Stack trace (from full thread dump)
{noformat}
"benchmark-worker-59"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)
{noformat}

Full thread dump
{noformat}
"ignite-#89%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"shmem-worker-#88%null%"
   java.lang.Thread.State: RUNNABLE
        at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryUtils.readSharedMemory(Native Method)
        at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemorySpace.read(IpcSharedMemorySpace.java:220)
        at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryInputStream.read(IpcSharedMemoryInputStream.java:62)
        at org.apache.ignite.internal.util.ipc.IpcToNioAdapter.serve(IpcToNioAdapter.java:114)
        at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$ShmemWorker.body(TcpCommunicationSpi.java:2943)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#87%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#85%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#83%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#81%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#79%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#77%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#75%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#73%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#71%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#69%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#67%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"grid-time-coordinator-#66%null%"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Object.wait(Native Method)
        at org.apache.ignite.internal.processors.clock.GridClockSyncProcessor$TimeCoordinator.body(GridClockSyncProcessor.java:386)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#64%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#62%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#61%marshaller-cache-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#60%marshaller-cache-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"DestroyJavaVM"
   java.lang.Thread.State: RUNNABLE

"benchmark-worker-63"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-62"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-61"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-60"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-59"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-58"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-57"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-56"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-55"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-54"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-53"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-52"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-51"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-50"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-49"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-48"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-47"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-46"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-45"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-44"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-43"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-42"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-41"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-40"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-39"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-38"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-37"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-36"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-35"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-34"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-33"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-32"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-31"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-30"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-29"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-28"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-27"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-26"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-25"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-24"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-23"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-22"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-21"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-20"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-19"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-18"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-17"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-16"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-15"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-14"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-13"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-12"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-11"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-10"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-9"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-8"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-7"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-6"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-5"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-4"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-3"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-2"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-1"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"benchmark-worker-0"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4556)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1569)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxy.get(IgniteCacheProxy.java:803)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:57)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark$1.call(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.doInTransaction(IgniteTransactionalWriteReadBenchmark.java:88)
        at org.apache.ignite.yardstick.cache.failover.IgniteTransactionalWriteReadBenchmark.test(IgniteTransactionalWriteReadBenchmark.java:52)
        at org.yardstickframework.impl.BenchmarkRunner$2.run(BenchmarkRunner.java:165)
        at java.lang.Thread.run(Thread.java:745)

"pool-1-thread-1"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"Thread-8"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.yardstickframework.impl.BenchmarkRunner$3.run(BenchmarkRunner.java:230)

"probe-dump-thread"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.yardstickframework.impl.BenchmarkProbeSet$1.run(BenchmarkProbeSet.java:136)

"Thread-7"
   java.lang.Thread.State: RUNNABLE
        at java.io.FileInputStream.readBytes(Native Method)
        at java.io.FileInputStream.read(FileInputStream.java:272)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:273)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283)
        at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325)
        at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177)
        at java.io.InputStreamReader.read(InputStreamReader.java:184)
        at java.io.BufferedReader.fill(BufferedReader.java:154)
        at java.io.BufferedReader.readLine(BufferedReader.java:317)
        at java.io.BufferedReader.readLine(BufferedReader.java:382)
        at org.yardstickframework.impl.util.BenchmarkProcessLauncher$StreamGrabber$2.run(BenchmarkProcessLauncher.java:113)
        at java.lang.Thread.run(Thread.java:745)

"Thread-6"
   java.lang.Thread.State: RUNNABLE
        at java.io.FileInputStream.readBytes(Native Method)
        at java.io.FileInputStream.read(FileInputStream.java:272)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:273)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283)
        at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325)
        at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177)
        at java.io.InputStreamReader.read(InputStreamReader.java:184)
        at java.io.BufferedReader.fill(BufferedReader.java:154)
        at java.io.BufferedReader.readLine(BufferedReader.java:317)
        at java.io.BufferedReader.readLine(BufferedReader.java:382)
        at org.yardstickframework.impl.util.BenchmarkProcessLauncher$StreamGrabber$2.run(BenchmarkProcessLauncher.java:113)
        at java.lang.Thread.run(Thread.java:745)

"thread-dump-printer"
   java.lang.Thread.State: RUNNABLE
        at sun.management.ThreadImpl.getThreadInfo1(Native Method)
        at sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:174)
        at org.apache.ignite.yardstick.cache.failover.RestartUtils.threadDump(RestartUtils.java:195)
        at org.apache.ignite.yardstick.cache.failover.IgniteFailoverAbstractBenchmark$2.run(IgniteFailoverAbstractBenchmark.java:131)
        at java.lang.Thread.run(Thread.java:745)

"restarter"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.apache.ignite.yardstick.cache.failover.IgniteFailoverAbstractBenchmark$1.run(IgniteFailoverAbstractBenchmark.java:76)
        at java.lang.Thread.run(Thread.java:745)

"srvc-deploy-#58%null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#57%utility-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"exchange-worker-#56%null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:157)
        at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:115)
        at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1154)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"grid-time-server-reader-#54%null%"
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainDatagramSocketImpl.receive0(Native Method)
        at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:146)
        at java.net.DatagramSocket.receive(DatagramSocket.java:816)
        at org.apache.ignite.internal.processors.clock.GridClockServer$ReadWorker.body(GridClockServer.java:199)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"disco-event-worker-#53%null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body0(GridDiscoveryManager.java:1982)
        at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body(GridDiscoveryManager.java:1964)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"tcp-client-disco-msg-worker-#4%null"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:489)
        at java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:678)
        at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1320)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

"tcp-client-disco-sock-reader-#3%null"
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at org.apache.ignite.marshaller.jdk.JdkMarshallerInputStreamWrapper.read(JdkMarshallerInputStreamWrapper.java:53)
        at java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
        at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
        at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
        at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
        at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
        at org.apache.ignite.marshaller.jdk.JdkMarshallerObjectInputStream.<init>(JdkMarshallerObjectInputStream.java:39)
        at org.apache.ignite.marshaller.jdk.JdkMarshaller.unmarshal(JdkMarshaller.java:100)
        at org.apache.ignite.spi.discovery.tcp.ClientImpl$SocketReader.body(ClientImpl.java:881)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

"tcp-client-disco-sock-writer-#2%null"
   java.lang.Thread.State: WAITING
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:503)
        at org.apache.ignite.spi.discovery.tcp.ClientImpl$SocketWriter.body(ClientImpl.java:1048)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

"TcpDiscoverySpi.timer"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        at java.util.TimerThread.run(Timer.java:505)

"grid-data-loader-flusher-#52%null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:209)
        at org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor$2.body(DataStreamProcessor.java:92)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"grid-nio-worker-3-#51%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1377)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1263)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"grid-nio-worker-2-#50%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1377)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1263)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"grid-nio-worker-1-#49%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1377)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1263)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"grid-nio-worker-0-#48%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1377)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1263)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"nio-acceptor-#47%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:1761)
        at org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:1733)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"tcp-comm-worker-#1%null"
   java.lang.Thread.State: TIMED_WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.body(TcpCommunicationSpi.java:2992)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

"grid-nio-worker-3-#45%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1377)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1263)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"grid-nio-worker-2-#44%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1377)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1263)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"grid-nio-worker-1-#43%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1377)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1263)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"grid-nio-worker-0-#42%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1377)
        at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1263)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"nio-acceptor-#41%null%"
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:1761)
        at org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:1733)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"shmem-communication-acceptor-#46%null%"
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
        at java.net.ServerSocket.implAccept(ServerSocket.java:530)
        at java.net.ServerSocket.accept(ServerSocket.java:498)
        at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint.accept(IpcSharedMemoryServerEndpoint.java:221)
        at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$ShmemAcceptWorker.body(TcpCommunicationSpi.java:2855)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"ipc-shmem-gc-#40%null%"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint$GcWorker.body(IpcSharedMemoryServerEndpoint.java:554)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"process reaper"
   java.lang.Thread.State: RUNNABLE
        at java.lang.UNIXProcess.waitForProcessExit(Native Method)
        at java.lang.UNIXProcess.access$500(UNIXProcess.java:54)
        at java.lang.UNIXProcess$4.run(UNIXProcess.java:227)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"grid-timeout-worker-#39%null%"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Object.wait(Native Method)
        at org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:184)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:745)

"ignite-update-notifier-timer"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.apache.ignite.internal.IgniteKernal$UpdateNotifierTimerTask.safeRun(IgniteKernal.java:3218)
        at org.apache.ignite.internal.util.GridTimerTask.run(GridTimerTask.java:34)
        at java.util.TimerThread.mainLoop(Timer.java:555)
        at java.util.TimerThread.run(Timer.java:505)

"upd-ver-checker"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.apache.ignite.internal.GridUpdateNotifier$2.run(GridUpdateNotifier.java:170)
        at java.lang.Thread.run(Thread.java:745)

"ignite-clock"
   java.lang.Thread.State: TIMED_WAITING
        at java.lang.Thread.sleep(Native Method)
        at org.apache.ignite.internal.util.IgniteUtils$21.run(IgniteUtils.java:3056)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#38%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#37%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#36%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#35%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#34%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#33%pub-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#32%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#31%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#30%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#29%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#28%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#27%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#26%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#25%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#24%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#23%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#22%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#21%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#20%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#19%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#18%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#17%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#16%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#15%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#14%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#13%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#12%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#11%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#10%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#9%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#8%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#7%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#6%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#5%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#4%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#3%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#2%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ignite-#1%sys-null%"
   java.lang.Thread.State: WAITING
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"Signal Dispatcher"
   java.lang.Thread.State: RUNNABLE

"Finalizer"
   java.lang.Thread.State: WAITING
        at java.lang.Object.wait(Native Method)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

"Reference Handler"
   java.lang.Thread.State: WAITING
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:503)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)