Text query with persistence

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Text query with persistence

dkarachentsev
Hi guys,

We have Apache Lucene based full text search that creates in-memory
indexes. It's a nice feature, but it seems absolutely useless with
persistence as indexes are dropped on node restart.

Probably we need a configuration flag and\or API call to rebuild them,
or persist somehow.

Do we have plans/ticket for that? Or maybe some tricky way to recreate
indexes?

Thanks!

-Dmitry

Reply | Threaded
Open this post in threaded view
|

Re: Text query with persistence

Alexey Goncharuk
Hi Dmitriy,

We do have a ticket for this [1], however, I am not sure it will be
completed any time soon.

As for the rebuilding indexes at the node startup, we already have an
internal routine for this (see GridQueryIndexing#rebuildIndexesFromHash).
The only thing we need to implement is skipping of regular indexes update
during the full-text index rebuild and maybe provide an API so that a user
can trigger this.

--Alexey

[1] https://issues.apache.org/jira/browse/IGNITE-5371

2018-02-07 11:30 GMT+03:00 Dmitry Karachentsev <[hidden email]>:

> Hi guys,
>
> We have Apache Lucene based full text search that creates in-memory
> indexes. It's a nice feature, but it seems absolutely useless with
> persistence as indexes are dropped on node restart.
>
> Probably we need a configuration flag and\or API call to rebuild them, or
> persist somehow.
>
> Do we have plans/ticket for that? Or maybe some tricky way to recreate
> indexes?
>
> Thanks!
>
> -Dmitry
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Text query with persistence

dkarachentsev
Thanks Alexey, I'll take a look on it!

07.02.2018 11:48, Alexey Goncharuk пишет:

> Hi Dmitriy,
>
> We do have a ticket for this [1], however, I am not sure it will be
> completed any time soon.
>
> As for the rebuilding indexes at the node startup, we already have an
> internal routine for this (see GridQueryIndexing#rebuildIndexesFromHash).
> The only thing we need to implement is skipping of regular indexes update
> during the full-text index rebuild and maybe provide an API so that a user
> can trigger this.
>
> --Alexey
>
> [1] https://issues.apache.org/jira/browse/IGNITE-5371
>
> 2018-02-07 11:30 GMT+03:00 Dmitry Karachentsev <[hidden email]>:
>
>> Hi guys,
>>
>> We have Apache Lucene based full text search that creates in-memory
>> indexes. It's a nice feature, but it seems absolutely useless with
>> persistence as indexes are dropped on node restart.
>>
>> Probably we need a configuration flag and\or API call to rebuild them, or
>> persist somehow.
>>
>> Do we have plans/ticket for that? Or maybe some tricky way to recreate
>> indexes?
>>
>> Thanks!
>>
>> -Dmitry
>>
>>