DataFrame integration does not support ARRAY type

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

DataFrame integration does not support ARRAY type

Valentin Kulichenko
Hi Nikolay,

Can you please take a look at this thread on SO?
https://stackoverflow.com/questions/51621280/saving-a-spark-dataset-to-apache-ignite-with-array-column-and-savemode-overwrite

Looks like org.apache.ignite.spark.impl.QueryUtils#dataType method should
also support ArrayType as one of the cases. Currently it doesn't and throws
an exception.

Is it a bug?

-Val
Reply | Threaded
Open this post in threaded view
|

Re: DataFrame integration does not support ARRAY type

Nikolay Izhikov-2
Hello, Valentin.

Yes, this is a bug.

Ticket created - https://issues.apache.org/jira/browse/IGNITE-9229

В Вт, 31/07/2018 в 16:01 -0700, Valentin Kulichenko пишет:
> Hi Nikolay,
>
> Can you please take a look at this thread on SO? https://stackoverflow.com/questions/51621280/saving-a-spark-dataset-to-apache-ignite-with-array-column-and-savemode-overwrite
>
> Looks like org.apache.ignite.spark.impl.QueryUtils#dataType method should also support ArrayType as one of the cases. Currently it doesn't and throws an exception.
>
> Is it a bug?
>
> -Val

signature.asc (499 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: DataFrame integration does not support ARRAY type

dsetrakyan
Would be nice if someone in the community would pick this ticket up.

On Wed, Aug 8, 2018 at 1:19 AM, Nikolay Izhikov <[hidden email]> wrote:

> Hello, Valentin.
>
> Yes, this is a bug.
>
> Ticket created - https://issues.apache.org/jira/browse/IGNITE-9229
>
> В Вт, 31/07/2018 в 16:01 -0700, Valentin Kulichenko пишет:
> > Hi Nikolay,
> >
> > Can you please take a look at this thread on SO?
> https://stackoverflow.com/questions/51621280/saving-a-
> spark-dataset-to-apache-ignite-with-array-column-and-savemode-overwrite
> >
> > Looks like org.apache.ignite.spark.impl.QueryUtils#dataType method
> should also support ArrayType as one of the cases. Currently it doesn't and
> throws an exception.
> >
> > Is it a bug?
> >
> > -Val
>
Reply | Threaded
Open this post in threaded view
|

Re: DataFrame integration does not support ARRAY type

Nikolay Izhikov-2
Dmitriy, I will take care of this ticket in a few days.

В Ср, 08/08/2018 в 18:06 -0500, Dmitriy Setrakyan пишет:

> Would be nice if someone in the community would pick this ticket up.
>
> On Wed, Aug 8, 2018 at 1:19 AM, Nikolay Izhikov <[hidden email]> wrote:
>
> > Hello, Valentin.
> >
> > Yes, this is a bug.
> >
> > Ticket created - https://issues.apache.org/jira/browse/IGNITE-9229
> >
> > В Вт, 31/07/2018 в 16:01 -0700, Valentin Kulichenko пишет:
> > > Hi Nikolay,
> > >
> > > Can you please take a look at this thread on SO?
> >
> > https://stackoverflow.com/questions/51621280/saving-a-
> > spark-dataset-to-apache-ignite-with-array-column-and-savemode-overwrite
> > >
> > > Looks like org.apache.ignite.spark.impl.QueryUtils#dataType method
> >
> > should also support ArrayType as one of the cases. Currently it doesn't and
> > throws an exception.
> > >
> > > Is it a bug?
> > >
> > > -Val

signature.asc (499 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: DataFrame integration does not support ARRAY type

dsetrakyan
On Thu, Aug 9, 2018 at 8:19 AM, Nikolay Izhikov <[hidden email]> wrote:

> Dmitriy, I will take care of this ticket in a few days.
>

Great!