[jira] [Created] (IGNITE-11058) Possible OOM due to large discard queue in TcpDiscoverySpi

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (IGNITE-11058) Possible OOM due to large discard queue in TcpDiscoverySpi

Anton Vinogradov (Jira)
Alexei Scherbakov created IGNITE-11058:
------------------------------------------

             Summary: Possible OOM due to large discard queue in TcpDiscoverySpi
                 Key: IGNITE-11058
                 URL: https://issues.apache.org/jira/browse/IGNITE-11058
             Project: Ignite
          Issue Type: Improvement
            Reporter: Alexei Scherbakov
             Fix For: 2.8


Currently it's necessary to store every ensured (marked with TcpDiscoveryEnsureDelivery annotation) in pending message queue until it's discarded from coordinator for implementing guaranteed delivery, otherwise if subsequent nodes will fail while forwarding message the guarantee couldn't be fulfilled.

On large topologies with active changes the queue may contain many very large messages causing heap usage bursts and possible OOM.

Possible solution:
 # off-load pending messages payload to off-heap or even on disk.
 # store messages in serialized form for avoiding JVM Object overhead.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)