Ignite RDD for Python

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Ignite RDD for Python

CBribiescas
It looks like there is no way to access and IgniteRDD from a python
SparkContext.

Our use case is wanting to share rdd's between Python and Scala.  Leveraging
the performance of Scala and the ds tools available in Python.

Are there any plans to implement this in the near future?



--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Ignite RDD for Python

dmagda
Hi,

If you can sacrifice Spark APIs in Python then use Ignite Python client like that [1] or connect from ODBC [2] directly. Hope that IgniteRDD support will be added for Python at some point on time but there are no any plans yet.

[1] https://github.com/dany74q/python-apache-ignite
[2] https://apacheignite.readme.io/docs/odbc-driver


Denis

> On Oct 23, 2017, at 7:59 AM, CBribiescas <[hidden email]> wrote:
>
> It looks like there is no way to access and IgniteRDD from a python
> SparkContext.
>
> Our use case is wanting to share rdd's between Python and Scala.  Leveraging
> the performance of Scala and the ds tools available in Python.
>
> Are there any plans to implement this in the near future?
>
>
>
> --
> Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/