Time and scope for Apache Ignite 2.4

[dmagda]

Igniters,

Basing on the amount of improvements, fixes and features stacked in the master branch I think it’s a right time to negotiate the scope and time of the next Apache Ignite 2.4 release. I’m ready to step in as a release manager if none of the committers wants to try on this role.

Here is a release page:
https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>

Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 24 - voting -> Jan 31 release.

In my view improvements such Java 9 support and Java 7 discontinuation, memory metrics in bytes [1], binary client protocol, etc. needs to get into the release. All the features like that are labeled “important” in JIRA. Use this label if you are convinced a task has to be release in 2.4.

What’s about machine learning, bulk loading [2], internals problems resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s shifted?

[1] https://issues.apache.org/jira/browse/IGNITE-6902 <https://issues.apache.org/jira/browse/IGNITE-6902>
[2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-1:+Bulk+data+loading+performance+improvements>
[3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection <https://cwiki.apache.org/confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
[4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-6:+Metrics+improvements>

—
Denis

[Valentin Kulichenko]

First part of Spark dataframe integration is likely to get into 2.4:
https://issues.apache.org/jira/browse/IGNITE-3084

-Val

On Mon, Dec 4, 2017 at 1:11 PM, Denis Magda <[hidden email]> wrote:

> Igniters,
>
> Basing on the amount of improvements, fixes and features stacked in the
> master branch I think it’s a right time to negotiate the scope and time of
> the next Apache Ignite 2.4 release. I’m ready to step in as a release
> manager if none of the committers wants to try on this role.
>
> Here is a release page:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
>
> Proposed time date: Jan 5 - code freeze -> stabilization and testing ->
> Jan 24 - voting -> Jan 31 release.
>
> In my view improvements such Java 9 support and Java 7 discontinuation,
> memory metrics in bytes [1], binary client protocol, etc. needs to get into
> the release. All the features like that are labeled “important” in JIRA.
> Use this label if you are convinced a task has to be release in 2.4.
>
> What’s about machine learning, bulk loading [2], internals problems
> resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s
> shifted?
>
> [1] https://issues.apache.org/jira/browse/IGNITE-6902 <
> https://issues.apache.org/jira/browse/IGNITE-6902>
> [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> 1%3A+Bulk+data+loading+performance+improvements <https://cwiki.apache.org/
> confluence/display/IGNITE/IEP-1:+Bulk+data+loading+
> performance+improvements>
> [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> 7%3A+Ignite+internal+problems+detection <https://cwiki.apache.org/
> confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
> [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> 6%3A+Metrics+improvements <https://cwiki.apache.org/
> confluence/display/IGNITE/IEP-6:+Metrics+improvements>
>
> —
> Denis

[Pavel Tupitsyn]

1) Thin Client Connector (server part) and .NET Thin Client are in master
and ready for release. See `thin client` component in JIRA.

2) .NET Core cross-platform support (Ignite.NET on Linux and macOS) also
are in master and ready:
https://issues.apache.org/jira/browse/IGNITE-2662
https://issues.apache.org/jira/browse/IGNITE-7013

Pavel




On Tue, Dec 5, 2017 at 2:05 AM, Valentin Kulichenko <
[hidden email]> wrote:

> First part of Spark dataframe integration is likely to get into 2.4:
> https://issues.apache.org/jira/browse/IGNITE-3084
>
> -Val
>
> On Mon, Dec 4, 2017 at 1:11 PM, Denis Magda <[hidden email]> wrote:
>
> > Igniters,
> >
> > Basing on the amount of improvements, fixes and features stacked in the
> > master branch I think it’s a right time to negotiate the scope and time
> of
> > the next Apache Ignite 2.4 release. I’m ready to step in as a release
> > manager if none of the committers wants to try on this role.
> >
> > Here is a release page:
> > https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <
> > https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
> >
> > Proposed time date: Jan 5 - code freeze -> stabilization and testing ->
> > Jan 24 - voting -> Jan 31 release.
> >
> > In my view improvements such Java 9 support and Java 7 discontinuation,
> > memory metrics in bytes [1], binary client protocol, etc. needs to get
> into
> > the release. All the features like that are labeled “important” in JIRA.
> > Use this label if you are convinced a task has to be release in 2.4.
> >
> > What’s about machine learning, bulk loading [2], internals problems
> > resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s
> > shifted?
> >
> > [1] https://issues.apache.org/jira/browse/IGNITE-6902 <
> > https://issues.apache.org/jira/browse/IGNITE-6902>
> > [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> > 1%3A+Bulk+data+loading+performance+improvements <
> https://cwiki.apache.org/
> > confluence/display/IGNITE/IEP-1:+Bulk+data+loading+
> > performance+improvements>
> > [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> > 7%3A+Ignite+internal+problems+detection <https://cwiki.apache.org/
> > confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
> > [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-
> > 6%3A+Metrics+improvements <https://cwiki.apache.org/
> > confluence/display/IGNITE/IEP-6:+Metrics+improvements>
> >
> > —
> > Denis
>

[agura]

Hi,

I'm working on WAL optimizations that improve performance
significantly [1]. I believe it's important task and should be
included in Apache Ignite 2.4 release.

[1] https://issues.apache.org/jira/browse/IGNITE-6339

On Tue, Dec 5, 2017 at 12:11 AM, Denis Magda <[hidden email]> wrote:

> Igniters,
>
> Basing on the amount of improvements, fixes and features stacked in the master branch I think it’s a right time to negotiate the scope and time of the next Apache Ignite 2.4 release. I’m ready to step in as a release manager if none of the committers wants to try on this role.
>
> Here is a release page:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
>
> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 24 - voting -> Jan 31 release.
>
> In my view improvements such Java 9 support and Java 7 discontinuation, memory metrics in bytes [1], binary client protocol, etc. needs to get into the release. All the features like that are labeled “important” in JIRA. Use this label if you are convinced a task has to be release in 2.4.
>
> What’s about machine learning, bulk loading [2], internals problems resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s shifted?
>
> [1] https://issues.apache.org/jira/browse/IGNITE-6902 <https://issues.apache.org/jira/browse/IGNITE-6902>
> [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-1:+Bulk+data+loading+performance+improvements>
> [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection <https://cwiki.apache.org/confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
> [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-6:+Metrics+improvements>
>
> —
> Denis

[dsetrakyan]

On Tue, Dec 5, 2017 at 7:13 AM, Andrey Gura <[hidden email]> wrote:

> Hi,
>
> I'm working on WAL optimizations that improve performance
> significantly [1]. I believe it's important task and should be
> included in Apache Ignite 2.4 release.
>
> [1] https://issues.apache.org/jira/browse/IGNITE-6339
>
>
Andrey, I do not believe that moving WAL processing to a separate thread
would provide a huge performance boost. Is there anything else you are
doing? If yes, can you please describe it in the ticket?

[Yuriy Babak]

Hi,

As for ML - so far so good and from my point of view all mentioned tasks
will be completed in this release.

Regards,
Yury



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

[Dmitriy Pavlov]

Hi,

I suggest to include Andrey's change with WAL standalone thread, this will
speed up Ignite at least because CRC calcs goes to user threads instead of
one writer thread. This brings also resistence to thread interrupt and
other benefits.

Change, which I'm currently working on, is a direct IO
https://issues.apache.org/jira/browse/IGNITE-6341  If benchmarks will show
that memory usage decreased, I suggest to include this change also.

Sincerely,
Dmitry Pavlov

Disclaimer: Opinions expressed in this email are those of the author,
and do not necessarily represent the views of any company the author
might be affiliated with at the moment of writing.


ср, 6 дек. 2017 г. в 11:35, Yury Babak <[hidden email]>:

> Hi,
>
> As for ML - so far so good and from my point of view all mentioned tasks
> will be completed in this release.
>
> Regards,
> Yury
>
>
>
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
>

[vveider]

Hi, Denis.

https://issues.apache.org/jira/browse/IGNITE-7107
https://issues.apache.org/jira/browse/IGNITE-7108



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

[Igor Sapego-2]

Hi Denis,

I've been working on SSL support for ODBC [1] for a while now, and I hope
to include it in 2.4, as well as some other minor improvements and bug fixes
for ODBC.

[1] - https://issues.apache.org/jira/browse/IGNITE-6810

Best Regards,
Igor

On Thu, Dec 7, 2017 at 11:51 AM, vveider <[hidden email]> wrote:

> Hi, Denis.
>
> https://issues.apache.org/jira/browse/IGNITE-7107
> https://issues.apache.org/jira/browse/IGNITE-7108
>
>
>
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
>

[agura]

Hi,

I've just updated the issue. Please take a look.

On Wed, Dec 6, 2017 at 6:44 AM, Dmitriy Setrakyan <[hidden email]> wrote:

> On Tue, Dec 5, 2017 at 7:13 AM, Andrey Gura <[hidden email]> wrote:
>
>> Hi,
>>
>> I'm working on WAL optimizations that improve performance
>> significantly [1]. I believe it's important task and should be
>> included in Apache Ignite 2.4 release.
>>
>> [1] https://issues.apache.org/jira/browse/IGNITE-6339
>>
>>
> Andrey, I do not believe that moving WAL processing to a separate thread
> would provide a huge performance boost. Is there anything else you are
> doing? If yes, can you please describe it in the ticket?

[dmagda]

Igniters,

It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets>

How good are we if to assume 5th of Jan as a code freeze date? Please comment:
- Nikolay Izhikov: Data Frames.
- Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
- Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
- Yuri: Machine Learning + neural networks
- Vladimir Ozerov: Java 9 and Java 7
- Sergey Kozlov: SQL scope testing
- etc.: please check the link with the features.

—
Denis

> On Dec 4, 2017, at 1:11 PM, Denis Magda <[hidden email]> wrote:
>
> Igniters,
>
> Basing on the amount of improvements, fixes and features stacked in the master branch I think it’s a right time to negotiate the scope and time of the next Apache Ignite 2.4 release. I’m ready to step in as a release manager if none of the committers wants to try on this role.
>
> Here is a release page:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
>
> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 24 - voting -> Jan 31 release.
>
> In my view improvements such Java 9 support and Java 7 discontinuation, memory metrics in bytes [1], binary client protocol, etc. needs to get into the release. All the features like that are labeled “important” in JIRA. Use this label if you are convinced a task has to be release in 2.4.
>
> What’s about machine learning, bulk loading [2], internals problems resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s shifted?
>
> [1] https://issues.apache.org/jira/browse/IGNITE-6902 <https://issues.apache.org/jira/browse/IGNITE-6902>
> [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-1:+Bulk+data+loading+performance+improvements>
> [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection <https://cwiki.apache.org/confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
> [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-6:+Metrics+improvements>
>
> —
> Denis

[Nikolay Izhikov]

Hello, Denis

> - Nikolay Izhikov: Data Frames.

I'm waiting for Valentin Kulichenko review.
If and when further comments for DataFrame pull request appears I will
fix them immediately.

В Вт, 19/12/2017 в 12:07 -0800, Denis Magda пишет:

> Igniters,
>
> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
> ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/confluence/
> display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets>
>
> How good are we if to assume 5th of Jan as a code freeze date? Please
> comment:
> - Nikolay Izhikov: Data Frames.
> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the
> list.
> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
> - Yuri: Machine Learning + neural networks
> - Vladimir Ozerov: Java 9 and Java 7
> - Sergey Kozlov: SQL scope testing
> - etc.: please check the link with the features.
>
> —
> Denis
> > On Dec 4, 2017, at 1:11 PM, Denis Magda <[hidden email]> wrote:
> >
> > Igniters,
> >
> > Basing on the amount of improvements, fixes and features stacked in
> > the master branch I think it’s a right time to negotiate the scope
> > and time of the next Apache Ignite 2.4 release. I’m ready to step
> > in as a release manager if none of the committers wants to try on
> > this role.
> >
> > Here is a release page:
> > https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.
> > 4 <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite
> > +2.4>
> >
> > Proposed time date: Jan 5 - code freeze -> stabilization and
> > testing -> Jan 24 - voting -> Jan 31 release.
> >
> > In my view improvements such Java 9 support and Java 7
> > discontinuation, memory metrics in bytes [1], binary client
> > protocol, etc. needs to get into the release. All the features like
> > that are labeled “important” in JIRA. Use this label if you are
> > convinced a task has to be release in 2.4.
> >
> > What’s about machine learning, bulk loading [2], internals problems
> > resolution [3], metrics [4] related tasks? What goes in 2.4 and
> > what’s shifted?
> >
> > [1] https://issues.apache.org/jira/browse/IGNITE-6902 <https://issu
> > es.apache.org/jira/browse/IGNITE-6902>
> > [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bul
> > k+data+loading+performance+improvements <https://cwiki.apache.org/c
> > onfluence/display/IGNITE/IEP-
> > 1:+Bulk+data+loading+performance+improvements>
> > [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ign
> > ite+internal+problems+detection <https://cwiki.apache.org/confluenc
> > e/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
> > [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Met
> > rics+improvements <https://cwiki.apache.org/confluence/display/IGNI
> > TE/IEP-6:+Metrics+improvements>
> >
> > —
> > Denis
>
>

[vveider]

Hi, Denis!


What about switching to Java 8 by default? [1]
I guess this task is inseparably connected to Java 7 support drop and Java 9 support introducing.


[1] https://issues.apache.org/jira/browse/IGNITE-7203

> On 19 Dec 2017, at 23:07, Denis Magda <[hidden email]> wrote:
>
> Igniters,
>
> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets>
>
> How good are we if to assume 5th of Jan as a code freeze date? Please comment:
> - Nikolay Izhikov: Data Frames.
> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
> - Yuri: Machine Learning + neural networks
> - Vladimir Ozerov: Java 9 and Java 7
> - Sergey Kozlov: SQL scope testing
> - etc.: please check the link with the features.
>
> —
> Denis
>> On Dec 4, 2017, at 1:11 PM, Denis Magda <[hidden email]> wrote:
>>
>> Igniters,
>>
>> Basing on the amount of improvements, fixes and features stacked in the master branch I think it’s a right time to negotiate the scope and time of the next Apache Ignite 2.4 release. I’m ready to step in as a release manager if none of the committers wants to try on this role.
>>
>> Here is a release page:
>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
>>
>> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 24 - voting -> Jan 31 release.
>>
>> In my view improvements such Java 9 support and Java 7 discontinuation, memory metrics in bytes [1], binary client protocol, etc. needs to get into the release. All the features like that are labeled “important” in JIRA. Use this label if you are convinced a task has to be release in 2.4.
>>
>> What’s about machine learning, bulk loading [2], internals problems resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s shifted?
>>
>> [1] https://issues.apache.org/jira/browse/IGNITE-6902 <https://issues.apache.org/jira/browse/IGNITE-6902>
>> [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-1:+Bulk+data+loading+performance+improvements>
>> [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection <https://cwiki.apache.org/confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
>> [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-6:+Metrics+improvements>
>>
>> —
>> Denis
>

[Andrey Kuznetsov]

Hi Denis,

As for memory metrics, I'm fixing minor bugs now, and then we'll need some
time for review.

2017-12-19 23:07 GMT+03:00 Denis Magda <[hidden email]>:

> Igniters,
>
> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
> ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/
> confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-
> RequiredTickets>
>
> How good are we if to assume 5th of Jan as a code freeze date? Please
> comment:
> - Nikolay Izhikov: Data Frames.
> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
> - Yuri: Machine Learning + neural networks
> - Vladimir Ozerov: Java 9 and Java 7
> - Sergey Kozlov: SQL scope testing
> - etc.: please check the link with the features.
>
> —
> Denis
>
> --

Best regards,
  Andrey Kuznetsov.

[dmagda]

Hi Peter,

Sorry for confusion, yes, I meant using Java 8 by default in Ignite. Labeled the Java 8 ticket with “important” and now it appears in the required tickets list:
https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets

As I see Yuri reviewed the ticket from ML perspective:
https://github.com/apache/ignite/pull/3240 <https://github.com/apache/ignite/pull/3240>

Do you guys collaborate together making sure the ML build process simplified? Do we need to create a sub-task of [1] to make sure it’s not missed?

[1] https://issues.apache.org/jira/browse/IGNITE-7203 <https://issues.apache.org/jira/browse/IGNITE-7203>

—
Denis

> On Dec 20, 2017, at 12:29 AM, Petr Ivanov <[hidden email]> wrote:
>
> Hi, Denis!
>
>
> What about switching to Java 8 by default? [1]
> I guess this task is inseparably connected to Java 7 support drop and Java 9 support introducing.
>
>
> [1] https://issues.apache.org/jira/browse/IGNITE-7203
>
>
>
>> On 19 Dec 2017, at 23:07, Denis Magda <[hidden email]> wrote:
>>
>> Igniters,
>>
>> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets>
>>
>> How good are we if to assume 5th of Jan as a code freeze date? Please comment:
>> - Nikolay Izhikov: Data Frames.
>> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
>> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
>> - Yuri: Machine Learning + neural networks
>> - Vladimir Ozerov: Java 9 and Java 7
>> - Sergey Kozlov: SQL scope testing
>> - etc.: please check the link with the features.
>>
>> —
>> Denis
>>> On Dec 4, 2017, at 1:11 PM, Denis Magda <[hidden email]> wrote:
>>>
>>> Igniters,
>>>
>>> Basing on the amount of improvements, fixes and features stacked in the master branch I think it’s a right time to negotiate the scope and time of the next Apache Ignite 2.4 release. I’m ready to step in as a release manager if none of the committers wants to try on this role.
>>>
>>> Here is a release page:
>>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
>>>
>>> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 24 - voting -> Jan 31 release.
>>>
>>> In my view improvements such Java 9 support and Java 7 discontinuation, memory metrics in bytes [1], binary client protocol, etc. needs to get into the release. All the features like that are labeled “important” in JIRA. Use this label if you are convinced a task has to be release in 2.4.
>>>
>>> What’s about machine learning, bulk loading [2], internals problems resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s shifted?
>>>
>>> [1] https://issues.apache.org/jira/browse/IGNITE-6902 <https://issues.apache.org/jira/browse/IGNITE-6902>
>>> [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-1:+Bulk+data+loading+performance+improvements>
>>> [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection <https://cwiki.apache.org/confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
>>> [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-6:+Metrics+improvements>
>>>
>>> —
>>> Denis
>>
>

[dmagda]

Andrey K., excellent progress! Do you think you will finish the task by the end of the year?

Furthermore, I see you are working on Java 9 specific tasks:
https://issues.apache.org/jira/browse/IGNITE-6728 <https://issues.apache.org/jira/browse/IGNITE-6728>

Is everything alright there? If you need a review try to ping a reviewer directly.

—
Denis

> On Dec 20, 2017, at 3:29 AM, Andrey Kuznetsov <[hidden email]> wrote:
>
> Hi Denis,
>
> As for memory metrics, I'm fixing minor bugs now, and then we'll need some
> time for review.
>
> 2017-12-19 23:07 GMT+03:00 Denis Magda <[hidden email]>:
>
>> Igniters,
>>
>> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
>> ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/
>> confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-
>> RequiredTickets>
>>
>> How good are we if to assume 5th of Jan as a code freeze date? Please
>> comment:
>> - Nikolay Izhikov: Data Frames.
>> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
>> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
>> - Yuri: Machine Learning + neural networks
>> - Vladimir Ozerov: Java 9 and Java 7
>> - Sergey Kozlov: SQL scope testing
>> - etc.: please check the link with the features.
>>
>> —
>> Denis
>>
>> --
> Best regards,
>  Andrey Kuznetsov.

[Andrey Kuznetsov]

Thanks, Denis!

I hope I'll finish the task on memory metrics in a couple of days.

2017-12-20 23:28 GMT+03:00 Denis Magda <[hidden email]>:

> Andrey K., excellent progress! Do you think you will finish the task by
> the end of the year?
>
> Furthermore, I see you are working on Java 9 specific tasks:
> https://issues.apache.org/jira/browse/IGNITE-6728 <
> https://issues.apache.org/jira/browse/IGNITE-6728>
>
> Is everything alright there? If you need a review try to ping a reviewer
> directly.
>
> —
> Denis
>
> > On Dec 20, 2017, at 3:29 AM, Andrey Kuznetsov <[hidden email]> wrote:
> >
> > Hi Denis,
> >
> > As for memory metrics, I'm fixing minor bugs now, and then we'll need
> some
> > time for review.
> >
> > 2017-12-19 23:07 GMT+03:00 Denis Magda <[hidden email]>:
> >
> >> Igniters,
> >>
> >> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
> >> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
> >> ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/
> >> confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-
> >> RequiredTickets>
> >>
> >> How good are we if to assume 5th of Jan as a code freeze date? Please
> >> comment:
> >> - Nikolay Izhikov: Data Frames.
> >> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the
> list.
> >> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
> >> - Yuri: Machine Learning + neural networks
> >> - Vladimir Ozerov: Java 9 and Java 7
> >> - Sergey Kozlov: SQL scope testing
> >> - etc.: please check the link with the features.
> >>
> >> —
> >> Denis
> >>
> >> --
> > Best regards,
> >  Andrey Kuznetsov.
>
>

--
Best regards,
  Andrey Kuznetsov.

[dmagda]

Please ping me or file a ticket following these rules [1] when this happens so that I could update this documentation page:
https://apacheignite.readme.io/docs/memory-metrics

[1] https://cwiki.apache.org/confluence/display/IGNITE/How+to+Document

—
Denis

> On Dec 20, 2017, at 12:56 PM, Andrey Kuznetsov <[hidden email]> wrote:
>
> Thanks, Denis!
>
> I hope I'll finish the task on memory metrics in a couple of days.
>
> 2017-12-20 23:28 GMT+03:00 Denis Magda <[hidden email]>:
>
>> Andrey K., excellent progress! Do you think you will finish the task by
>> the end of the year?
>>
>> Furthermore, I see you are working on Java 9 specific tasks:
>> https://issues.apache.org/jira/browse/IGNITE-6728 <
>> https://issues.apache.org/jira/browse/IGNITE-6728>
>>
>> Is everything alright there? If you need a review try to ping a reviewer
>> directly.
>>
>> —
>> Denis
>>
>>> On Dec 20, 2017, at 3:29 AM, Andrey Kuznetsov <[hidden email]> wrote:
>>>
>>> Hi Denis,
>>>
>>> As for memory metrics, I'm fixing minor bugs now, and then we'll need
>> some
>>> time for review.
>>>
>>> 2017-12-19 23:07 GMT+03:00 Denis Magda <[hidden email]>:
>>>
>>>> Igniters,
>>>>
>>>> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
>>>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#
>>>> ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/
>>>> confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-
>>>> RequiredTickets>
>>>>
>>>> How good are we if to assume 5th of Jan as a code freeze date? Please
>>>> comment:
>>>> - Nikolay Izhikov: Data Frames.
>>>> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the
>> list.
>>>> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
>>>> - Yuri: Machine Learning + neural networks
>>>> - Vladimir Ozerov: Java 9 and Java 7
>>>> - Sergey Kozlov: SQL scope testing
>>>> - etc.: please check the link with the features.
>>>>
>>>> —
>>>> Denis
>>>>
>>>> --
>>> Best regards,
>>> Andrey Kuznetsov.
>>
>>
>
>
> --
> Best regards,
>  Andrey Kuznetsov.

[vveider]

Hi, Denis.


Yes, we collaborated with Yuri and are currently waiting for Ignite Tests run results (though I’ll be able to start full comparison run only on weekend because of extremely high TC load) to be sure that 1) I did not break overall build and 2) building and testing on Java 8 produces similar (more or less, considering fact that some tests are flaky) result so we can switch to new TC test project "Ignite Tests 2.0 (java-8)”.

Hope the changes will see themselves in master on the beginning of the following week.

> On 20 Dec 2017, at 23:22, Denis Magda <[hidden email]> wrote:
>
> Hi Peter,
>
> Sorry for confusion, yes, I meant using Java 8 by default in Ignite. Labeled the Java 8 ticket with “important” and now it appears in the required tickets list:
> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets
>
> As I see Yuri reviewed the ticket from ML perspective:
> https://github.com/apache/ignite/pull/3240 <https://github.com/apache/ignite/pull/3240>
>
> Do you guys collaborate together making sure the ML build process simplified? Do we need to create a sub-task of [1] to make sure it’s not missed?
>
> [1] https://issues.apache.org/jira/browse/IGNITE-7203 <https://issues.apache.org/jira/browse/IGNITE-7203>
>
> —
> Denis
>
>> On Dec 20, 2017, at 12:29 AM, Petr Ivanov <[hidden email]> wrote:
>>
>> Hi, Denis!
>>
>>
>> What about switching to Java 8 by default? [1]
>> I guess this task is inseparably connected to Java 7 support drop and Java 9 support introducing.
>>
>>
>> [1] https://issues.apache.org/jira/browse/IGNITE-7203
>>
>>
>>
>>> On 19 Dec 2017, at 23:07, Denis Magda <[hidden email]> wrote:
>>>
>>> Igniters,
>>>
>>> It’s time to sync up on the progress of IMPORTANT tasks for 2.4:
>>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4#ApacheIgnite2.4-RequiredTickets>
>>>
>>> How good are we if to assume 5th of Jan as a code freeze date? Please comment:
>>> - Nikolay Izhikov: Data Frames.
>>> - Sergey Kalashnikov, Vladimir Ozerov: DDL and SQL features from the list.
>>> - Andrey Kuznetsov, Alexandr Fedotov: memory metrics tasks.
>>> - Yuri: Machine Learning + neural networks
>>> - Vladimir Ozerov: Java 9 and Java 7
>>> - Sergey Kozlov: SQL scope testing
>>> - etc.: please check the link with the features.
>>>
>>> —
>>> Denis
>>>> On Dec 4, 2017, at 1:11 PM, Denis Magda <[hidden email]> wrote:
>>>>
>>>> Igniters,
>>>>
>>>> Basing on the amount of improvements, fixes and features stacked in the master branch I think it’s a right time to negotiate the scope and time of the next Apache Ignite 2.4 release. I’m ready to step in as a release manager if none of the committers wants to try on this role.
>>>>
>>>> Here is a release page:
>>>> https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4 <https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.4>
>>>>
>>>> Proposed time date: Jan 5 - code freeze -> stabilization and testing -> Jan 24 - voting -> Jan 31 release.
>>>>
>>>> In my view improvements such Java 9 support and Java 7 discontinuation, memory metrics in bytes [1], binary client protocol, etc. needs to get into the release. All the features like that are labeled “important” in JIRA. Use this label if you are convinced a task has to be release in 2.4.
>>>>
>>>> What’s about machine learning, bulk loading [2], internals problems resolution [3], metrics [4] related tasks? What goes in 2.4 and what’s shifted?
>>>>
>>>> [1] https://issues.apache.org/jira/browse/IGNITE-6902 <https://issues.apache.org/jira/browse/IGNITE-6902>
>>>> [2] https://cwiki.apache.org/confluence/display/IGNITE/IEP-1%3A+Bulk+data+loading+performance+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-1:+Bulk+data+loading+performance+improvements>
>>>> [3] https://cwiki.apache.org/confluence/display/IGNITE/IEP-7%3A+Ignite+internal+problems+detection <https://cwiki.apache.org/confluence/display/IGNITE/IEP-7:+Ignite+internal+problems+detection>
>>>> [4] https://cwiki.apache.org/confluence/display/IGNITE/IEP-6%3A+Metrics+improvements <https://cwiki.apache.org/confluence/display/IGNITE/IEP-6:+Metrics+improvements>
>>>>
>>>> —
>>>> Denis
>>>
>>
>

[Yuriy Babak]

Hi Denis,

as for ML - we on track. For this release we have FCM, Decision tree, KNN,
Model/Trainer API, Neural Network introduction and bunch of improvements and
bugfixes.

Also we slightly change our plan for NN. In this release we will add
distributed(and local) MLP(multilayer perceptron) instead of
CNN(Convolutional neural network).

Regards,
Yury



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/