[jira] [Created] (IGNITE-3414) Hadoop: Optimize map-reduce job planning.

[Anton Vinogradov (Jira)]

Vladimir Ozerov created IGNITE-3414:
---------------------------------------

             Summary: Hadoop: Optimize map-reduce job planning.
                 Key: IGNITE-3414
                 URL: https://issues.apache.org/jira/browse/IGNITE-3414
             Project: Ignite
          Issue Type: Task
          Components: hadoop
    Affects Versions: 1.6
            Reporter: Vladimir Ozerov
            Assignee: Vladimir Ozerov
            Priority: Critical
             Fix For: 1.7


Currently Hadoop module has inefficient map-reduce planning engine. In particular, it assigns tasks only to affinity nodes. It could lead to situation when very huge tasks is processed by a single cluster node, while other cluster nodes are idle.

We should implement configurable map-reduce planner which will be able to utilize the whole cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)