[jira] [Created] (IGNITE-4516) Hadoop: add optional gzip compression for shuffle output

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (IGNITE-4516) Hadoop: add optional gzip compression for shuffle output

Anton Vinogradov (Jira)
Vladimir Ozerov created IGNITE-4516:
---------------------------------------

             Summary: Hadoop: add optional gzip compression for shuffle output
                 Key: IGNITE-4516
                 URL: https://issues.apache.org/jira/browse/IGNITE-4516
             Project: Ignite
          Issue Type: Task
          Components: hadoop
            Reporter: Vladimir Ozerov
            Assignee: Vladimir Ozerov
             Fix For: 2.0


It was already implemented, but then reverted back due to performance drop. However, this feature might still be very useful because it decrease amount of heap memory required to store intermediate output for remote nodes.

See commit 0062362.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)