Getting errors while setup new cluster using existing cluster data

[Gangaiah Gundeboina]

Hi Guys,

We have one live cluster(2.6 native persistence) which serving read and
write continuously. Want to setup new cluster using existing cluster data
without stopping.

After coping the existing cluster data files, removed metastorage, wal, wal
archive and cp data. And then started the all nodes, getting errors while
cluster activation like jvm pause and record search.

To do this, can some one suggest us what all things need to take care before
staring nodes in new cluster.


Thanks in advance.



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

[dmagda]

Hi Gangaiah,

Not sure that removal of WAL and cp is a good idea as long as those can
keep info about changes that were not applied checkpointed or applied to
persistence files yet.

A safe way to copy the data is to turn off the write workloads to the
primary cluster, ensure that checkpointing is finished and then copy the
data files.

Another approach is to replicate changes to another cluster via Kafka-like
approaches or use snapshots of GridGain.

-
Denis


On Mon, Dec 2, 2019 at 9:30 AM Gangaiah Gundeboina <[hidden email]>
wrote:

> Hi Guys,
>
> We have one live cluster(2.6 native persistence) which serving read and
> write continuously. Want to setup new cluster using existing cluster data
> without stopping.
>
> After coping the existing cluster data files, removed metastorage, wal, wal
> archive and cp data. And then started the all nodes, getting errors while
> cluster activation like jvm pause and record search.
>
> To do this, can some one suggest us what all things need to take care
> before
> staring nodes in new cluster.
>
>
> Thanks in advance.
>
>
>
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
>

[Gangaiah Gundeboina]

Thanks Denis.

It's ok to loose delta data(which are writing data to cluster while coping),
but want to up the cluster whatever data is valid.

Is there any way.

I don't have idea about Kafka-like approach, will check.

Thanks and Regards,
Gangaiah



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/

[Ilya Kasnacheev]

Hello!

I don't think Apache Ignite supports it. We even clear caches explicitly if
a node was reset when WAL was disabled, and your scenario is just like this
one but worse.

Regards,
--
Ilya Kasnacheev


ср, 4 дек. 2019 г. в 20:43, Gangaiah Gundeboina <[hidden email]>:

> Thanks Denis.
>
> It's ok to loose delta data(which are writing data to cluster while
> coping),
> but want to up the cluster whatever data is valid.
>
> Is there any way.
>
> I don't have idea about Kafka-like approach, will check.
>
> Thanks and Regards,
> Gangaiah
>
>
>
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
>