Data consistency essentials explained

classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

Data consistency essentials explained

Alexei Scherbakov
Igniters,

As a final action in my almost year long effort in repairing data
consistency related issues for transactional persistent caches I've
prepared an article explaining the principles of achieving the consistency
between partition copies for these scenarios [1]
Comments and suggestions are welcome.
I plan to keep the article in actual state if something will change in this
area in the future.
Fixes were mostly done under IGNITE-10780 and several follow-up fixes.

There is still work to be done. Currently I'm working on similar issue for
atomic persistent caches [2]. I hope to give an update on that soon.

[1]  https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
[2] https://issues.apache.org/jira/browse/IGNITE-11797
--

Best regards,
Alexei Scherbakov
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Anton Vinogradov-2
Great news, thanks!

On Wed, Nov 27, 2019 at 11:29 AM Alexei Scherbakov <
[hidden email]> wrote:

> Igniters,
>
> As a final action in my almost year long effort in repairing data
> consistency related issues for transactional persistent caches I've
> prepared an article explaining the principles of achieving the consistency
> between partition copies for these scenarios [1]
> Comments and suggestions are welcome.
> I plan to keep the article in actual state if something will change in this
> area in the future.
> Fixes were mostly done under IGNITE-10780 and several follow-up fixes.
>
> There is still work to be done. Currently I'm working on similar issue for
> atomic persistent caches [2]. I hope to give an update on that soon.
>
> [1]  https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> --
>
> Best regards,
> Alexei Scherbakov
>
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

dmagda
In reply to this post by Alexei Scherbakov
Alex,

Thanks a lot for putting your knowledge on paper. That's an invaluable
contribution!

Looping in the user community (will be interesting for those who use native
persistence) and has just spread the word via Ignite twitter handle:
https://twitter.com/ApacheIgnite/status/1199837055007612928

-
Denis


On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
[hidden email]> wrote:

> Igniters,
>
> As a final action in my almost year long effort in repairing data
> consistency related issues for transactional persistent caches I've
> prepared an article explaining the principles of achieving the consistency
> between partition copies for these scenarios [1]
> Comments and suggestions are welcome.
> I plan to keep the article in actual state if something will change in this
> area in the future.
> Fixes were mostly done under IGNITE-10780 and several follow-up fixes.
>
> There is still work to be done. Currently I'm working on similar issue for
> atomic persistent caches [2]. I hope to give an update on that soon.
>
> [1]  https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> --
>
> Best regards,
> Alexei Scherbakov
>
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Ivan Pavlukhin
Alexei,

Many thanks for that article! Really nice that now we have a document
describing Ignite approach for data consistency. I think it is super
important because it is not trivial and very Ignite specific. I
believe lots of Ignite developers will learn something new from this
document.

By the way, I noticed a link to GridGain documentation [1]. Is it fine?

[1] https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions

чт, 28 нояб. 2019 г. в 02:49, Denis Magda <[hidden email]>:

>
> Alex,
>
> Thanks a lot for putting your knowledge on paper. That's an invaluable contribution!
>
> Looping in the user community (will be interesting for those who use native persistence) and has just spread the word via Ignite twitter handle:
> https://twitter.com/ApacheIgnite/status/1199837055007612928
>
> -
> Denis
>
>
> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <[hidden email]> wrote:
>>
>> Igniters,
>>
>> As a final action in my almost year long effort in repairing data
>> consistency related issues for transactional persistent caches I've
>> prepared an article explaining the principles of achieving the consistency
>> between partition copies for these scenarios [1]
>> Comments and suggestions are welcome.
>> I plan to keep the article in actual state if something will change in this
>> area in the future.
>> Fixes were mostly done under IGNITE-10780 and several follow-up fixes.
>>
>> There is still work to be done. Currently I'm working on similar issue for
>> atomic persistent caches [2]. I hope to give an update on that soon.
>>
>> [1]  https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
>> --
>>
>> Best regards,
>> Alexei Scherbakov



--
Best regards,
Ivan Pavlukhin
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Nikolay Izhikov-2
Hello, Alex.

I think we should improve article formatting - code highlight, fonts, etc.

For now, it’s very hard to read it.

Can you, please, do it?

> 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin <[hidden email]> написал(а):
>
> Alexei,
>
> Many thanks for that article! Really nice that now we have a document
> describing Ignite approach for data consistency. I think it is super
> important because it is not trivial and very Ignite specific. I
> believe lots of Ignite developers will learn something new from this
> document.
>
> By the way, I noticed a link to GridGain documentation [1]. Is it fine?
>
> [1] https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
>
> чт, 28 нояб. 2019 г. в 02:49, Denis Magda <[hidden email]>:
>>
>> Alex,
>>
>> Thanks a lot for putting your knowledge on paper. That's an invaluable contribution!
>>
>> Looping in the user community (will be interesting for those who use native persistence) and has just spread the word via Ignite twitter handle:
>> https://twitter.com/ApacheIgnite/status/1199837055007612928
>>
>> -
>> Denis
>>
>>
>> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <[hidden email]> wrote:
>>>
>>> Igniters,
>>>
>>> As a final action in my almost year long effort in repairing data
>>> consistency related issues for transactional persistent caches I've
>>> prepared an article explaining the principles of achieving the consistency
>>> between partition copies for these scenarios [1]
>>> Comments and suggestions are welcome.
>>> I plan to keep the article in actual state if something will change in this
>>> area in the future.
>>> Fixes were mostly done under IGNITE-10780 and several follow-up fixes.
>>>
>>> There is still work to be done. Currently I'm working on similar issue for
>>> atomic persistent caches [2]. I hope to give an update on that soon.
>>>
>>> [1]  https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
>>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
>>> --
>>>
>>> Best regards,
>>> Alexei Scherbakov
>
>
>
> --
> Best regards,
> Ivan Pavlukhin

Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Alexei Scherbakov
Ivan, the link is intentional.

Nikolai, the formatting looks ok to me. Feel free to change it however you
like.

чт, 28 нояб. 2019 г. в 09:53, Николай Ижиков <[hidden email]>:

> Hello, Alex.
>
> I think we should improve article formatting - code highlight, fonts, etc.
>
> For now, it’s very hard to read it.
>
> Can you, please, do it?
>
> > 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin <[hidden email]>
> написал(а):
> >
> > Alexei,
> >
> > Many thanks for that article! Really nice that now we have a document
> > describing Ignite approach for data consistency. I think it is super
> > important because it is not trivial and very Ignite specific. I
> > believe lots of Ignite developers will learn something new from this
> > document.
> >
> > By the way, I noticed a link to GridGain documentation [1]. Is it fine?
> >
> > [1]
> https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
> >
> > чт, 28 нояб. 2019 г. в 02:49, Denis Magda <[hidden email]>:
> >>
> >> Alex,
> >>
> >> Thanks a lot for putting your knowledge on paper. That's an invaluable
> contribution!
> >>
> >> Looping in the user community (will be interesting for those who use
> native persistence) and has just spread the word via Ignite twitter handle:
> >> https://twitter.com/ApacheIgnite/status/1199837055007612928
> >>
> >> -
> >> Denis
> >>
> >>
> >> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
> [hidden email]> wrote:
> >>>
> >>> Igniters,
> >>>
> >>> As a final action in my almost year long effort in repairing data
> >>> consistency related issues for transactional persistent caches I've
> >>> prepared an article explaining the principles of achieving the
> consistency
> >>> between partition copies for these scenarios [1]
> >>> Comments and suggestions are welcome.
> >>> I plan to keep the article in actual state if something will change in
> this
> >>> area in the future.
> >>> Fixes were mostly done under IGNITE-10780 and several follow-up fixes.
> >>>
> >>> There is still work to be done. Currently I'm working on similar issue
> for
> >>> atomic persistent caches [2]. I hope to give an update on that soon.
> >>>
> >>> [1]
> https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> >>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> >>> --
> >>>
> >>> Best regards,
> >>> Alexei Scherbakov
> >
> >
> >
> > --
> > Best regards,
> > Ivan Pavlukhin
>
>

--

Best regards,
Alexei Scherbakov
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Ivan Pavlukhin
Alexei,

> Ivan, the link is intentional.

Could you please elaborate why is it fine to have a such link? The
referred document is out of community control. Do not we have a
similar one in Ignite documentation? Should we discuss it in another
mail thread?

сб, 30 нояб. 2019 г. в 15:48, Alexei Scherbakov <[hidden email]>:

>
> Ivan, the link is intentional.
>
> Nikolai, the formatting looks ok to me. Feel free to change it however you
> like.
>
> чт, 28 нояб. 2019 г. в 09:53, Николай Ижиков <[hidden email]>:
>
> > Hello, Alex.
> >
> > I think we should improve article formatting - code highlight, fonts, etc.
> >
> > For now, it’s very hard to read it.
> >
> > Can you, please, do it?
> >
> > > 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin <[hidden email]>
> > написал(а):
> > >
> > > Alexei,
> > >
> > > Many thanks for that article! Really nice that now we have a document
> > > describing Ignite approach for data consistency. I think it is super
> > > important because it is not trivial and very Ignite specific. I
> > > believe lots of Ignite developers will learn something new from this
> > > document.
> > >
> > > By the way, I noticed a link to GridGain documentation [1]. Is it fine?
> > >
> > > [1]
> > https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
> > >
> > > чт, 28 нояб. 2019 г. в 02:49, Denis Magda <[hidden email]>:
> > >>
> > >> Alex,
> > >>
> > >> Thanks a lot for putting your knowledge on paper. That's an invaluable
> > contribution!
> > >>
> > >> Looping in the user community (will be interesting for those who use
> > native persistence) and has just spread the word via Ignite twitter handle:
> > >> https://twitter.com/ApacheIgnite/status/1199837055007612928
> > >>
> > >> -
> > >> Denis
> > >>
> > >>
> > >> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
> > [hidden email]> wrote:
> > >>>
> > >>> Igniters,
> > >>>
> > >>> As a final action in my almost year long effort in repairing data
> > >>> consistency related issues for transactional persistent caches I've
> > >>> prepared an article explaining the principles of achieving the
> > consistency
> > >>> between partition copies for these scenarios [1]
> > >>> Comments and suggestions are welcome.
> > >>> I plan to keep the article in actual state if something will change in
> > this
> > >>> area in the future.
> > >>> Fixes were mostly done under IGNITE-10780 and several follow-up fixes.
> > >>>
> > >>> There is still work to be done. Currently I'm working on similar issue
> > for
> > >>> atomic persistent caches [2]. I hope to give an update on that soon.
> > >>>
> > >>> [1]
> > https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> > >>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> > >>> --
> > >>>
> > >>> Best regards,
> > >>> Alexei Scherbakov
> > >
> > >
> > >
> > > --
> > > Best regards,
> > > Ivan Pavlukhin
> >
> >
>
> --
>
> Best regards,
> Alexei Scherbakov



--
Best regards,
Ivan Pavlukhin
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Alexei Scherbakov
Ivan,

for me GG docs have more clear information on the subject.
As soon as community will improve docs quality link could be changed back
to Apache.

сб, 30 нояб. 2019 г. в 17:22, Ivan Pavlukhin <[hidden email]>:

> Alexei,
>
> > Ivan, the link is intentional.
>
> Could you please elaborate why is it fine to have a such link? The
> referred document is out of community control. Do not we have a
> similar one in Ignite documentation? Should we discuss it in another
> mail thread?
>
> сб, 30 нояб. 2019 г. в 15:48, Alexei Scherbakov <
> [hidden email]>:
> >
> > Ivan, the link is intentional.
> >
> > Nikolai, the formatting looks ok to me. Feel free to change it however
> you
> > like.
> >
> > чт, 28 нояб. 2019 г. в 09:53, Николай Ижиков <[hidden email]>:
> >
> > > Hello, Alex.
> > >
> > > I think we should improve article formatting - code highlight, fonts,
> etc.
> > >
> > > For now, it’s very hard to read it.
> > >
> > > Can you, please, do it?
> > >
> > > > 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin <[hidden email]>
> > > написал(а):
> > > >
> > > > Alexei,
> > > >
> > > > Many thanks for that article! Really nice that now we have a document
> > > > describing Ignite approach for data consistency. I think it is super
> > > > important because it is not trivial and very Ignite specific. I
> > > > believe lots of Ignite developers will learn something new from this
> > > > document.
> > > >
> > > > By the way, I noticed a link to GridGain documentation [1]. Is it
> fine?
> > > >
> > > > [1]
> > >
> https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
> > > >
> > > > чт, 28 нояб. 2019 г. в 02:49, Denis Magda <[hidden email]>:
> > > >>
> > > >> Alex,
> > > >>
> > > >> Thanks a lot for putting your knowledge on paper. That's an
> invaluable
> > > contribution!
> > > >>
> > > >> Looping in the user community (will be interesting for those who use
> > > native persistence) and has just spread the word via Ignite twitter
> handle:
> > > >> https://twitter.com/ApacheIgnite/status/1199837055007612928
> > > >>
> > > >> -
> > > >> Denis
> > > >>
> > > >>
> > > >> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
> > > [hidden email]> wrote:
> > > >>>
> > > >>> Igniters,
> > > >>>
> > > >>> As a final action in my almost year long effort in repairing data
> > > >>> consistency related issues for transactional persistent caches I've
> > > >>> prepared an article explaining the principles of achieving the
> > > consistency
> > > >>> between partition copies for these scenarios [1]
> > > >>> Comments and suggestions are welcome.
> > > >>> I plan to keep the article in actual state if something will
> change in
> > > this
> > > >>> area in the future.
> > > >>> Fixes were mostly done under IGNITE-10780 and several follow-up
> fixes.
> > > >>>
> > > >>> There is still work to be done. Currently I'm working on similar
> issue
> > > for
> > > >>> atomic persistent caches [2]. I hope to give an update on that
> soon.
> > > >>>
> > > >>> [1]
> > > https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> > > >>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> > > >>> --
> > > >>>
> > > >>> Best regards,
> > > >>> Alexei Scherbakov
> > > >
> > > >
> > > >
> > > > --
> > > > Best regards,
> > > > Ivan Pavlukhin
> > >
> > >
> >
> > --
> >
> > Best regards,
> > Alexei Scherbakov
>
>
>
> --
> Best regards,
> Ivan Pavlukhin
>


--

Best regards,
Alexei Scherbakov
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Ivan Pavlukhin
Alexei,

Am I getting it right that the article is relevant for current master
and there is no released Ignite versions with described behavior? Is
it mentioned in the document? Should we do it? What do you think?

вт, 3 дек. 2019 г. в 12:34, Alexei Scherbakov <[hidden email]>:

>
> Ivan,
>
> for me GG docs have more clear information on the subject.
> As soon as community will improve docs quality link could be changed back
> to Apache.
>
> сб, 30 нояб. 2019 г. в 17:22, Ivan Pavlukhin <[hidden email]>:
>
> > Alexei,
> >
> > > Ivan, the link is intentional.
> >
> > Could you please elaborate why is it fine to have a such link? The
> > referred document is out of community control. Do not we have a
> > similar one in Ignite documentation? Should we discuss it in another
> > mail thread?
> >
> > сб, 30 нояб. 2019 г. в 15:48, Alexei Scherbakov <
> > [hidden email]>:
> > >
> > > Ivan, the link is intentional.
> > >
> > > Nikolai, the formatting looks ok to me. Feel free to change it however
> > you
> > > like.
> > >
> > > чт, 28 нояб. 2019 г. в 09:53, Николай Ижиков <[hidden email]>:
> > >
> > > > Hello, Alex.
> > > >
> > > > I think we should improve article formatting - code highlight, fonts,
> > etc.
> > > >
> > > > For now, it’s very hard to read it.
> > > >
> > > > Can you, please, do it?
> > > >
> > > > > 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin <[hidden email]>
> > > > написал(а):
> > > > >
> > > > > Alexei,
> > > > >
> > > > > Many thanks for that article! Really nice that now we have a document
> > > > > describing Ignite approach for data consistency. I think it is super
> > > > > important because it is not trivial and very Ignite specific. I
> > > > > believe lots of Ignite developers will learn something new from this
> > > > > document.
> > > > >
> > > > > By the way, I noticed a link to GridGain documentation [1]. Is it
> > fine?
> > > > >
> > > > > [1]
> > > >
> > https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
> > > > >
> > > > > чт, 28 нояб. 2019 г. в 02:49, Denis Magda <[hidden email]>:
> > > > >>
> > > > >> Alex,
> > > > >>
> > > > >> Thanks a lot for putting your knowledge on paper. That's an
> > invaluable
> > > > contribution!
> > > > >>
> > > > >> Looping in the user community (will be interesting for those who use
> > > > native persistence) and has just spread the word via Ignite twitter
> > handle:
> > > > >> https://twitter.com/ApacheIgnite/status/1199837055007612928
> > > > >>
> > > > >> -
> > > > >> Denis
> > > > >>
> > > > >>
> > > > >> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
> > > > [hidden email]> wrote:
> > > > >>>
> > > > >>> Igniters,
> > > > >>>
> > > > >>> As a final action in my almost year long effort in repairing data
> > > > >>> consistency related issues for transactional persistent caches I've
> > > > >>> prepared an article explaining the principles of achieving the
> > > > consistency
> > > > >>> between partition copies for these scenarios [1]
> > > > >>> Comments and suggestions are welcome.
> > > > >>> I plan to keep the article in actual state if something will
> > change in
> > > > this
> > > > >>> area in the future.
> > > > >>> Fixes were mostly done under IGNITE-10780 and several follow-up
> > fixes.
> > > > >>>
> > > > >>> There is still work to be done. Currently I'm working on similar
> > issue
> > > > for
> > > > >>> atomic persistent caches [2]. I hope to give an update on that
> > soon.
> > > > >>>
> > > > >>> [1]
> > > > https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> > > > >>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> > > > >>> --
> > > > >>>
> > > > >>> Best regards,
> > > > >>> Alexei Scherbakov
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best regards,
> > > > > Ivan Pavlukhin
> > > >
> > > >
> > >
> > > --
> > >
> > > Best regards,
> > > Alexei Scherbakov
> >
> >
> >
> > --
> > Best regards,
> > Ivan Pavlukhin
> >
>
>
> --
>
> Best regards,
> Alexei Scherbakov



--
Best regards,
Ivan Pavlukhin
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Alexei Scherbakov
Ivan,

It's true. The article is relevant for upcoming 2.8 release. I've added a
remark on that.

пн, 9 дек. 2019 г. в 15:44, Ivan Pavlukhin <[hidden email]>:

> Alexei,
>
> Am I getting it right that the article is relevant for current master
> and there is no released Ignite versions with described behavior? Is
> it mentioned in the document? Should we do it? What do you think?
>
> вт, 3 дек. 2019 г. в 12:34, Alexei Scherbakov <
> [hidden email]>:
> >
> > Ivan,
> >
> > for me GG docs have more clear information on the subject.
> > As soon as community will improve docs quality link could be changed back
> > to Apache.
> >
> > сб, 30 нояб. 2019 г. в 17:22, Ivan Pavlukhin <[hidden email]>:
> >
> > > Alexei,
> > >
> > > > Ivan, the link is intentional.
> > >
> > > Could you please elaborate why is it fine to have a such link? The
> > > referred document is out of community control. Do not we have a
> > > similar one in Ignite documentation? Should we discuss it in another
> > > mail thread?
> > >
> > > сб, 30 нояб. 2019 г. в 15:48, Alexei Scherbakov <
> > > [hidden email]>:
> > > >
> > > > Ivan, the link is intentional.
> > > >
> > > > Nikolai, the formatting looks ok to me. Feel free to change it
> however
> > > you
> > > > like.
> > > >
> > > > чт, 28 нояб. 2019 г. в 09:53, Николай Ижиков <[hidden email]>:
> > > >
> > > > > Hello, Alex.
> > > > >
> > > > > I think we should improve article formatting - code highlight,
> fonts,
> > > etc.
> > > > >
> > > > > For now, it’s very hard to read it.
> > > > >
> > > > > Can you, please, do it?
> > > > >
> > > > > > 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin <[hidden email]>
> > > > > написал(а):
> > > > > >
> > > > > > Alexei,
> > > > > >
> > > > > > Many thanks for that article! Really nice that now we have a
> document
> > > > > > describing Ignite approach for data consistency. I think it is
> super
> > > > > > important because it is not trivial and very Ignite specific. I
> > > > > > believe lots of Ignite developers will learn something new from
> this
> > > > > > document.
> > > > > >
> > > > > > By the way, I noticed a link to GridGain documentation [1]. Is it
> > > fine?
> > > > > >
> > > > > > [1]
> > > > >
> > >
> https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
> > > > > >
> > > > > > чт, 28 нояб. 2019 г. в 02:49, Denis Magda <[hidden email]>:
> > > > > >>
> > > > > >> Alex,
> > > > > >>
> > > > > >> Thanks a lot for putting your knowledge on paper. That's an
> > > invaluable
> > > > > contribution!
> > > > > >>
> > > > > >> Looping in the user community (will be interesting for those
> who use
> > > > > native persistence) and has just spread the word via Ignite twitter
> > > handle:
> > > > > >> https://twitter.com/ApacheIgnite/status/1199837055007612928
> > > > > >>
> > > > > >> -
> > > > > >> Denis
> > > > > >>
> > > > > >>
> > > > > >> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
> > > > > [hidden email]> wrote:
> > > > > >>>
> > > > > >>> Igniters,
> > > > > >>>
> > > > > >>> As a final action in my almost year long effort in repairing
> data
> > > > > >>> consistency related issues for transactional persistent caches
> I've
> > > > > >>> prepared an article explaining the principles of achieving the
> > > > > consistency
> > > > > >>> between partition copies for these scenarios [1]
> > > > > >>> Comments and suggestions are welcome.
> > > > > >>> I plan to keep the article in actual state if something will
> > > change in
> > > > > this
> > > > > >>> area in the future.
> > > > > >>> Fixes were mostly done under IGNITE-10780 and several follow-up
> > > fixes.
> > > > > >>>
> > > > > >>> There is still work to be done. Currently I'm working on
> similar
> > > issue
> > > > > for
> > > > > >>> atomic persistent caches [2]. I hope to give an update on that
> > > soon.
> > > > > >>>
> > > > > >>> [1]
> > > > >
> https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> > > > > >>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> > > > > >>> --
> > > > > >>>
> > > > > >>> Best regards,
> > > > > >>> Alexei Scherbakov
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Best regards,
> > > > > > Ivan Pavlukhin
> > > > >
> > > > >
> > > >
> > > > --
> > > >
> > > > Best regards,
> > > > Alexei Scherbakov
> > >
> > >
> > >
> > > --
> > > Best regards,
> > > Ivan Pavlukhin
> > >
> >
> >
> > --
> >
> > Best regards,
> > Alexei Scherbakov
>
>
>
> --
> Best regards,
> Ivan Pavlukhin
>


--

Best regards,
Alexei Scherbakov
Reply | Threaded
Open this post in threaded view
|

Re: Data consistency essentials explained

Ivan Pavlukhin
Thank you!

пн, 9 дек. 2019 г. в 19:08, Alexei Scherbakov <[hidden email]>:

>
> Ivan,
>
> It's true. The article is relevant for upcoming 2.8 release. I've added a
> remark on that.
>
> пн, 9 дек. 2019 г. в 15:44, Ivan Pavlukhin <[hidden email]>:
>
> > Alexei,
> >
> > Am I getting it right that the article is relevant for current master
> > and there is no released Ignite versions with described behavior? Is
> > it mentioned in the document? Should we do it? What do you think?
> >
> > вт, 3 дек. 2019 г. в 12:34, Alexei Scherbakov <
> > [hidden email]>:
> > >
> > > Ivan,
> > >
> > > for me GG docs have more clear information on the subject.
> > > As soon as community will improve docs quality link could be changed back
> > > to Apache.
> > >
> > > сб, 30 нояб. 2019 г. в 17:22, Ivan Pavlukhin <[hidden email]>:
> > >
> > > > Alexei,
> > > >
> > > > > Ivan, the link is intentional.
> > > >
> > > > Could you please elaborate why is it fine to have a such link? The
> > > > referred document is out of community control. Do not we have a
> > > > similar one in Ignite documentation? Should we discuss it in another
> > > > mail thread?
> > > >
> > > > сб, 30 нояб. 2019 г. в 15:48, Alexei Scherbakov <
> > > > [hidden email]>:
> > > > >
> > > > > Ivan, the link is intentional.
> > > > >
> > > > > Nikolai, the formatting looks ok to me. Feel free to change it
> > however
> > > > you
> > > > > like.
> > > > >
> > > > > чт, 28 нояб. 2019 г. в 09:53, Николай Ижиков <[hidden email]>:
> > > > >
> > > > > > Hello, Alex.
> > > > > >
> > > > > > I think we should improve article formatting - code highlight,
> > fonts,
> > > > etc.
> > > > > >
> > > > > > For now, it’s very hard to read it.
> > > > > >
> > > > > > Can you, please, do it?
> > > > > >
> > > > > > > 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin <[hidden email]>
> > > > > > написал(а):
> > > > > > >
> > > > > > > Alexei,
> > > > > > >
> > > > > > > Many thanks for that article! Really nice that now we have a
> > document
> > > > > > > describing Ignite approach for data consistency. I think it is
> > super
> > > > > > > important because it is not trivial and very Ignite specific. I
> > > > > > > believe lots of Ignite developers will learn something new from
> > this
> > > > > > > document.
> > > > > > >
> > > > > > > By the way, I noticed a link to GridGain documentation [1]. Is it
> > > > fine?
> > > > > > >
> > > > > > > [1]
> > > > > >
> > > >
> > https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
> > > > > > >
> > > > > > > чт, 28 нояб. 2019 г. в 02:49, Denis Magda <[hidden email]>:
> > > > > > >>
> > > > > > >> Alex,
> > > > > > >>
> > > > > > >> Thanks a lot for putting your knowledge on paper. That's an
> > > > invaluable
> > > > > > contribution!
> > > > > > >>
> > > > > > >> Looping in the user community (will be interesting for those
> > who use
> > > > > > native persistence) and has just spread the word via Ignite twitter
> > > > handle:
> > > > > > >> https://twitter.com/ApacheIgnite/status/1199837055007612928
> > > > > > >>
> > > > > > >> -
> > > > > > >> Denis
> > > > > > >>
> > > > > > >>
> > > > > > >> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
> > > > > > [hidden email]> wrote:
> > > > > > >>>
> > > > > > >>> Igniters,
> > > > > > >>>
> > > > > > >>> As a final action in my almost year long effort in repairing
> > data
> > > > > > >>> consistency related issues for transactional persistent caches
> > I've
> > > > > > >>> prepared an article explaining the principles of achieving the
> > > > > > consistency
> > > > > > >>> between partition copies for these scenarios [1]
> > > > > > >>> Comments and suggestions are welcome.
> > > > > > >>> I plan to keep the article in actual state if something will
> > > > change in
> > > > > > this
> > > > > > >>> area in the future.
> > > > > > >>> Fixes were mostly done under IGNITE-10780 and several follow-up
> > > > fixes.
> > > > > > >>>
> > > > > > >>> There is still work to be done. Currently I'm working on
> > similar
> > > > issue
> > > > > > for
> > > > > > >>> atomic persistent caches [2]. I hope to give an update on that
> > > > soon.
> > > > > > >>>
> > > > > > >>> [1]
> > > > > >
> > https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> > > > > > >>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> > > > > > >>> --
> > > > > > >>>
> > > > > > >>> Best regards,
> > > > > > >>> Alexei Scherbakov
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Best regards,
> > > > > > > Ivan Pavlukhin
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Best regards,
> > > > > Alexei Scherbakov
> > > >
> > > >
> > > >
> > > > --
> > > > Best regards,
> > > > Ivan Pavlukhin
> > > >
> > >
> > >
> > > --
> > >
> > > Best regards,
> > > Alexei Scherbakov
> >
> >
> >
> > --
> > Best regards,
> > Ivan Pavlukhin
> >
>
>
> --
>
> Best regards,
> Alexei Scherbakov



--
Best regards,
Ivan Pavlukhin