[jira] [Created] (IGNITE-10912) Huge node join request discovery message slows down node joining and corresponding PME

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (IGNITE-10912) Huge node join request discovery message slows down node joining and corresponding PME

Anton Vinogradov (Jira)
Alexei Scherbakov created IGNITE-10912:
------------------------------------------

             Summary: Huge node join request discovery message slows down node joining and corresponding PME
                 Key: IGNITE-10912
                 URL: https://issues.apache.org/jira/browse/IGNITE-10912
             Project: Ignite
          Issue Type: Improvement
            Reporter: Alexei Scherbakov
             Fix For: 2.8


WIth large topology and large number of caches/groups node join message can reach a size > 30M due to a large amount of transferred discovery data.

It adds overhead on ring traversal and slows down "node join" PME.

Possible solution:
 # introduce pre-join message with discovery data which doesn't increment topology version. After all nodes wil have corressponding discovery data start actual joining. Discovery data probably should be stored off-heap(or even on disk) to avoid heap usage bursts on joining of multiple nodes.
 # Add compression to discovery data.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)