Lucene text index persistent ?

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

Lucene text index persistent ?

Tâm Nguyễn Mạnh
Hi Igniters,

Since Ignite have native persistent option to store data into disk, but not
text indexes. I saw this issue marked as Won't Fix. May I know the reason
we are not going to store text indexes into disk for now ?

--
Thanks & Best Regards

Tam, Nguyen Manh
Reply | Threaded
Open this post in threaded view
|

Re: Lucene text index persistent ?

Ilya Kasnacheev
Hello!

- Lucene indexes are not persistent and there are currently no plans to
make them persistent.
- I could say more about that ticket have you actually linked to it.

Regards,
--
Ilya Kasnacheev


ср, 20 мар. 2019 г. в 09:23, Tâm Nguyễn Mạnh <[hidden email]>:

> Hi Igniters,
>
> Since Ignite have native persistent option to store data into disk, but not
> text indexes. I saw this issue marked as Won't Fix. May I know the reason
> we are not going to store text indexes into disk for now ?
>
> --
> Thanks & Best Regards
>
> Tam, Nguyen Manh
>
Reply | Threaded
Open this post in threaded view
|

Re: Lucene text index persistent ?

Mmuzaf
Hello,

The link [1] is the issue with Persistence for text indices.

AFAIK, the issue is very difficult with their implementation and has a
doubtful performance improvement. One of the most obvious
disadvantages of persisted Lucene indexes can be that they will
dramatically slow down the node start time. So, probably, better to
keep them in-memory only.

[1] https://issues.apache.org/jira/browse/IGNITE-5371

On Wed, 20 Mar 2019 at 12:31, Ilya Kasnacheev <[hidden email]> wrote:

>
> Hello!
>
> - Lucene indexes are not persistent and there are currently no plans to
> make them persistent.
> - I could say more about that ticket have you actually linked to it.
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> ср, 20 мар. 2019 г. в 09:23, Tâm Nguyễn Mạnh <[hidden email]>:
>
> > Hi Igniters,
> >
> > Since Ignite have native persistent option to store data into disk, but not
> > text indexes. I saw this issue marked as Won't Fix. May I know the reason
> > we are not going to store text indexes into disk for now ?
> >
> > --
> > Thanks & Best Regards
> >
> > Tam, Nguyen Manh
> >
Reply | Threaded
Open this post in threaded view
|

Re: Lucene text index persistent ?

Dmitry Pavlov
+1 for keeping indexes as is. Moreover, sorry for off-topic Lucene is not
modular (Jigsaw-compliant), and having this dependency in ignite-indexing
make this jar also Java module - incompliant.

ср, 20 мар. 2019 г. в 13:15, Maxim Muzafarov <[hidden email]>:

> Hello,
>
> The link [1] is the issue with Persistence for text indices.
>
> AFAIK, the issue is very difficult with their implementation and has a
> doubtful performance improvement. One of the most obvious
> disadvantages of persisted Lucene indexes can be that they will
> dramatically slow down the node start time. So, probably, better to
> keep them in-memory only.
>
> [1] https://issues.apache.org/jira/browse/IGNITE-5371
>
> On Wed, 20 Mar 2019 at 12:31, Ilya Kasnacheev <[hidden email]>
> wrote:
> >
> > Hello!
> >
> > - Lucene indexes are not persistent and there are currently no plans to
> > make them persistent.
> > - I could say more about that ticket have you actually linked to it.
> >
> > Regards,
> > --
> > Ilya Kasnacheev
> >
> >
> > ср, 20 мар. 2019 г. в 09:23, Tâm Nguyễn Mạnh <[hidden email]
> >:
> >
> > > Hi Igniters,
> > >
> > > Since Ignite have native persistent option to store data into disk,
> but not
> > > text indexes. I saw this issue marked as Won't Fix. May I know the
> reason
> > > we are not going to store text indexes into disk for now ?
> > >
> > > --
> > > Thanks & Best Regards
> > >
> > > Tam, Nguyen Manh
> > >
>
Reply | Threaded
Open this post in threaded view
|

Re: Lucene text index persistent ?

dmagda
I think that we as the community should consider discontinuing the
full-text search support. It goes with many limitations and not widely
used. The market is flooded with many products designed for full-text
search scenarios.

-
Denis


On Wed, Mar 20, 2019 at 3:44 AM Dmitriy Pavlov <[hidden email]> wrote:

> +1 for keeping indexes as is. Moreover, sorry for off-topic Lucene is not
> modular (Jigsaw-compliant), and having this dependency in ignite-indexing
> make this jar also Java module - incompliant.
>
> ср, 20 мар. 2019 г. в 13:15, Maxim Muzafarov <[hidden email]>:
>
> > Hello,
> >
> > The link [1] is the issue with Persistence for text indices.
> >
> > AFAIK, the issue is very difficult with their implementation and has a
> > doubtful performance improvement. One of the most obvious
> > disadvantages of persisted Lucene indexes can be that they will
> > dramatically slow down the node start time. So, probably, better to
> > keep them in-memory only.
> >
> > [1] https://issues.apache.org/jira/browse/IGNITE-5371
> >
> > On Wed, 20 Mar 2019 at 12:31, Ilya Kasnacheev <[hidden email]
> >
> > wrote:
> > >
> > > Hello!
> > >
> > > - Lucene indexes are not persistent and there are currently no plans to
> > > make them persistent.
> > > - I could say more about that ticket have you actually linked to it.
> > >
> > > Regards,
> > > --
> > > Ilya Kasnacheev
> > >
> > >
> > > ср, 20 мар. 2019 г. в 09:23, Tâm Nguyễn Mạnh <
> [hidden email]
> > >:
> > >
> > > > Hi Igniters,
> > > >
> > > > Since Ignite have native persistent option to store data into disk,
> > but not
> > > > text indexes. I saw this issue marked as Won't Fix. May I know the
> > reason
> > > > we are not going to store text indexes into disk for now ?
> > > >
> > > > --
> > > > Thanks & Best Regards
> > > >
> > > > Tam, Nguyen Manh
> > > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Lucene text index persistent ?

Tâm Nguyễn Mạnh
Hi,

I tried to restart ignite node with persistent cache that have text index.
After restarted, text query return nothing. I guess because of in memory
lucene index was gone. What do i need to do to sort this out?

On Thu, Mar 21, 2019 at 12:48 AM Denis Magda <[hidden email]> wrote:

> I think that we as the community should consider discontinuing the
> full-text search support. It goes with many limitations and not widely
> used. The market is flooded with many products designed for full-text
> search scenarios.
>
> -
> Denis
>
>
> On Wed, Mar 20, 2019 at 3:44 AM Dmitriy Pavlov <[hidden email]> wrote:
>
> > +1 for keeping indexes as is. Moreover, sorry for off-topic Lucene is not
> > modular (Jigsaw-compliant), and having this dependency in ignite-indexing
> > make this jar also Java module - incompliant.
> >
> > ср, 20 мар. 2019 г. в 13:15, Maxim Muzafarov <[hidden email]>:
> >
> > > Hello,
> > >
> > > The link [1] is the issue with Persistence for text indices.
> > >
> > > AFAIK, the issue is very difficult with their implementation and has a
> > > doubtful performance improvement. One of the most obvious
> > > disadvantages of persisted Lucene indexes can be that they will
> > > dramatically slow down the node start time. So, probably, better to
> > > keep them in-memory only.
> > >
> > > [1] https://issues.apache.org/jira/browse/IGNITE-5371
> > >
> > > On Wed, 20 Mar 2019 at 12:31, Ilya Kasnacheev <
> [hidden email]
> > >
> > > wrote:
> > > >
> > > > Hello!
> > > >
> > > > - Lucene indexes are not persistent and there are currently no plans
> to
> > > > make them persistent.
> > > > - I could say more about that ticket have you actually linked to it.
> > > >
> > > > Regards,
> > > > --
> > > > Ilya Kasnacheev
> > > >
> > > >
> > > > ср, 20 мар. 2019 г. в 09:23, Tâm Nguyễn Mạnh <
> > [hidden email]
> > > >:
> > > >
> > > > > Hi Igniters,
> > > > >
> > > > > Since Ignite have native persistent option to store data into disk,
> > > but not
> > > > > text indexes. I saw this issue marked as Won't Fix. May I know the
> > > reason
> > > > > we are not going to store text indexes into disk for now ?
> > > > >
> > > > > --
> > > > > Thanks & Best Regards
> > > > >
> > > > > Tam, Nguyen Manh
> > > > >
> > >
> >
>


--
Thanks & Best Regards

Tam, Nguyen Manh
Reply | Threaded
Open this post in threaded view
|

Re: Lucene text index persistent ?

Manu
Hi! take a look to
https://github.com/hawkore/examples-apache-ignite-extensions/ they are
implemented a solution for persisted lucene and spatial indexes



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Lucene text index persistent ?

Ivan Pavlukhin
Hi Manu,

As I understood you provide a link to samples showing how extensions
could be used. Do you know whether source code for extensions
(persistent text indices, etc.) is available?

Best regards,
Ivan Pavlukhin

пн, 10 февр. 2020 г. в 14:03, Manu <[hidden email]>:
>
> Hi! take a look to
> https://github.com/hawkore/examples-apache-ignite-extensions/ they are
> implemented a solution for persisted lucene and spatial indexes
>
>
>
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Lucene text index persistent ?

Ivan Pavlukhin
Hi Manu,

As I understood you provide a link to samples showing how extensions
could be used. Do you know whether source code for extensions
(persistent text indices, etc.) is available?

Best regards,
Ivan Pavlukhin

пн, 17 февр. 2020 г. в 20:48, Ivan Pavlukhin <[hidden email]>:

>
> Hi Manu,
>
> As I understood you provide a link to samples showing how extensions
> could be used. Do you know whether source code for extensions
> (persistent text indices, etc.) is available?
>
> Best regards,
> Ivan Pavlukhin
>
> пн, 10 февр. 2020 г. в 14:03, Manu <[hidden email]>:
> >
> > Hi! take a look to
> > https://github.com/hawkore/examples-apache-ignite-extensions/ they are
> > implemented a solution for persisted lucene and spatial indexes
> >
> >
> >
> > --
> > Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/