IGNITE-1195

[Sergey Kozlov]

Hi Igniters

I suppose that issue below won't be fixed in nearest release 1.4.

IGNITE-1195 Released Ignite version 1.3.0 does not build with
-Dhadoop.version=2.6.0 <https://issues.apache.org/jira/browse/IGNITE-1195>

Thus I think we need to update DEVNOTES.txt and add workaround for building
hadoop edition for particular hadoop version. It could be something like
that:

*Ignite Hadoop Accelerator Maven Build Instructions*
*============================================*
*mvn clean package -DskipTests -Dignite.edition=hadoop
[-Dhadoop.version=X.X.X]*

*Use 'hadoop.version' parameter to build Ignite against a specific Hadoop
version. Due known issue IGNITE-1195
(https://issues.apache.org/jira/browse/IGNITE-1195
<https://issues.apache.org/jira/browse/IGNITE-1195>) module yarn must be
excluded for this case:*

*1. For maven version prior 3.2.1 **comment
out <module>modules/yarn</module> in pom.xml and build.*

*2. For maven version 3.2.1 or newest:  *
*mvn clean package -DskipTests -Dignite.edition=hadoop
-Dhadoop.version=X.X.X -pl !module/yarn*

Thoughts? Objections?

--
Sergey Kozlov

[dsetrakyan]

Is there any reason why support for the Hadoop 2.6 version is not going to
work? Can someone describe what needs to be done for us to fix this?

On Wed, Sep 2, 2015 at 11:58 AM, Sergey Kozlov <[hidden email]> wrote:

> Hi Igniters
>
> I suppose that issue below won't be fixed in nearest release 1.4.
>
> IGNITE-1195 Released Ignite version 1.3.0 does not build with
> -Dhadoop.version=2.6.0 <https://issues.apache.org/jira/browse/IGNITE-1195>
>
> Thus I think we need to update DEVNOTES.txt and add workaround for building
> hadoop edition for particular hadoop version. It could be something like
> that:
>
> *Ignite Hadoop Accelerator Maven Build Instructions*
> *============================================*
> *mvn clean package -DskipTests -Dignite.edition=hadoop
> [-Dhadoop.version=X.X.X]*
>
> *Use 'hadoop.version' parameter to build Ignite against a specific Hadoop
> version. Due known issue IGNITE-1195
> (https://issues.apache.org/jira/browse/IGNITE-1195
> <https://issues.apache.org/jira/browse/IGNITE-1195>) module yarn must be
> excluded for this case:*
>
> *1. For maven version prior 3.2.1 **comment
> out <module>modules/yarn</module> in pom.xml and build.*
>
> *2. For maven version 3.2.1 or newest:  *
> *mvn clean package -DskipTests -Dignite.edition=hadoop
> -Dhadoop.version=X.X.X -pl !module/yarn*
>
> Thoughts? Objections?
>
> --
> Sergey Kozlov
>

[Sergey Kozlov]

It's not for 2.6.0 only. Same issue are for 2.5.2 and 2.7.1

On Wed, Sep 2, 2015 at 10:28 PM, Dmitriy Setrakyan <[hidden email]>
wrote:

> Is there any reason why support for the Hadoop 2.6 version is not going to
> work? Can someone describe what needs to be done for us to fix this?
>
> On Wed, Sep 2, 2015 at 11:58 AM, Sergey Kozlov <[hidden email]>
> wrote:
>
> > Hi Igniters
> >
> > I suppose that issue below won't be fixed in nearest release 1.4.
> >
> > IGNITE-1195 Released Ignite version 1.3.0 does not build with
> > -Dhadoop.version=2.6.0 <
> https://issues.apache.org/jira/browse/IGNITE-1195>
> >
> > Thus I think we need to update DEVNOTES.txt and add workaround for
> building
> > hadoop edition for particular hadoop version. It could be something like
> > that:
> >
> > *Ignite Hadoop Accelerator Maven Build Instructions*
> > *============================================*
> > *mvn clean package -DskipTests -Dignite.edition=hadoop
> > [-Dhadoop.version=X.X.X]*
> >
> > *Use 'hadoop.version' parameter to build Ignite against a specific Hadoop
> > version. Due known issue IGNITE-1195
> > (https://issues.apache.org/jira/browse/IGNITE-1195
> > <https://issues.apache.org/jira/browse/IGNITE-1195>) module yarn must be
> > excluded for this case:*
> >
> > *1. For maven version prior 3.2.1 **comment
> > out <module>modules/yarn</module> in pom.xml and build.*
> >
> > *2. For maven version 3.2.1 or newest:  *
> > *mvn clean package -DskipTests -Dignite.edition=hadoop
> > -Dhadoop.version=X.X.X -pl !module/yarn*
> >
> > Thoughts? Objections?
> >
> > --
> > Sergey Kozlov
> >
>

--
Sergey Kozlov

[dsetrakyan]

On Wed, Sep 2, 2015 at 12:31 PM, Sergey Kozlov <[hidden email]> wrote:

> It's not for 2.6.0 only. Same issue are for 2.5.2 and 2.7.1
>

I think the same question stands - what is the main challenge here?

>
> On Wed, Sep 2, 2015 at 10:28 PM, Dmitriy Setrakyan <[hidden email]>
> wrote:
>
> > Is there any reason why support for the Hadoop 2.6 version is not going
> to
> > work? Can someone describe what needs to be done for us to fix this?
> >
> > On Wed, Sep 2, 2015 at 11:58 AM, Sergey Kozlov <[hidden email]>
> > wrote:
> >
> > > Hi Igniters
> > >
> > > I suppose that issue below won't be fixed in nearest release 1.4.
> > >
> > > IGNITE-1195 Released Ignite version 1.3.0 does not build with
> > > -Dhadoop.version=2.6.0 <
> > https://issues.apache.org/jira/browse/IGNITE-1195>
> > >
> > > Thus I think we need to update DEVNOTES.txt and add workaround for
> > building
> > > hadoop edition for particular hadoop version. It could be something
> like
> > > that:
> > >
> > > *Ignite Hadoop Accelerator Maven Build Instructions*
> > > *============================================*
> > > *mvn clean package -DskipTests -Dignite.edition=hadoop
> > > [-Dhadoop.version=X.X.X]*
> > >
> > > *Use 'hadoop.version' parameter to build Ignite against a specific
> Hadoop
> > > version. Due known issue IGNITE-1195
> > > (https://issues.apache.org/jira/browse/IGNITE-1195
> > > <https://issues.apache.org/jira/browse/IGNITE-1195>) module yarn must
> be
> > > excluded for this case:*
> > >
> > > *1. For maven version prior 3.2.1 **comment
> > > out <module>modules/yarn</module> in pom.xml and build.*
> > >
> > > *2. For maven version 3.2.1 or newest:  *
> > > *mvn clean package -DskipTests -Dignite.edition=hadoop
> > > -Dhadoop.version=X.X.X -pl !module/yarn*
> > >
> > > Thoughts? Objections?
> > >
> > > --
> > > Sergey Kozlov
> > >
> >
>
>
>
> --
> Sergey Kozlov
>

[Nikolay Tikhonov]

>
> I think the same question stands - what is the main challenge here?

Yarn module is compatible with Hadoop version 2.7.0 and above. Exist two
way: set different variables for yarn and hadoop modules or make yarn
module compiled with older hadoop versions.

[Sergey Kozlov]

We could use the brief explanation:

*if build fails due known issue IGNITE-1195 please remove yarn module from
root pom.xml or exclude via -pl !/modules/yarn (for maven version >= 3.2.1)*

On Mon, Sep 7, 2015 at 4:24 PM, Nikolay Tikhonov <[hidden email]>
wrote:

> >
> > I think the same question stands - what is the main challenge here?
>
> Yarn module is compatible with Hadoop version 2.7.0 and above. Exist two
> way: set different variables for yarn and hadoop modules or make yarn
> module compiled with older hadoop versions.
>



--
Sergey Kozlov

[dsetrakyan]

On Mon, Sep 7, 2015 at 6:24 AM, Nikolay Tikhonov <[hidden email]>
wrote:

> >
> > I think the same question stands - what is the main challenge here?
>
> Yarn module is compatible with Hadoop version 2.7.0 and above. Exist two
> way: set different variables for yarn and hadoop modules or make yarn
> module compiled with older hadoop versions.
>

I am confused. Are we saying that we work with 2.7.0, but not 2.6.0? I this
case I am OK disabling the Yarn module during the build. Nick, can you
confirm?

[Konstantin Boudnik-2]

That's what we do in Bigtop, cause otherwise there's no way of building the
stack on top of Hadoop 2.6.0


On Mon, Sep 07, 2015 at 10:09AM, Dmitriy Setrakyan wrote:

> On Mon, Sep 7, 2015 at 6:24 AM, Nikolay Tikhonov <[hidden email]>
> wrote:
>
> > >
> > > I think the same question stands - what is the main challenge here?
> >
> > Yarn module is compatible with Hadoop version 2.7.0 and above. Exist two
> > way: set different variables for yarn and hadoop modules or make yarn
> > module compiled with older hadoop versions.
> >
>
> I am confused. Are we saying that we work with 2.7.0, but not 2.6.0? I this
> case I am OK disabling the Yarn module during the build. Nick, can you
> confirm?

[Nikolay Tikhonov]

>
> I am confused. Are we saying that we work with 2.7.0, but not 2.6.0? I this
> case I am OK disabling the Yarn module during the build. Nick, can you
> confirm?
>

Yes. Sergey Kozlov in first message describe how disable Yarn module during
the build.