[jira] [Created] (IGNITE-7077) Spark Data Frame Support. Convert complete query to Ignite SQL

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (IGNITE-7077) Spark Data Frame Support. Convert complete query to Ignite SQL

Anton Vinogradov (Jira)
Nikolay Izhikov created IGNITE-7077:
---------------------------------------

             Summary: Spark Data Frame Support. Convert complete query to Ignite SQL
                 Key: IGNITE-7077
                 URL: https://issues.apache.org/jira/browse/IGNITE-7077
             Project: Ignite
          Issue Type: Task
          Components: spark
    Affects Versions: 2.3
            Reporter: Nikolay Izhikov
            Assignee: Nikolay Izhikov
             Fix For: 2.4


Basic support of Spark Data Frame for Ignite implemented in IGNITE-3084.

We need to implement custom spark strategy that can convert whole Spark SQL query to Ignite SQL Query if query consists of only Ignite tables.
The strategy does nothing if spark query includes not only Ignite tables.

Memsql implementation can be taken as an example - https://github.com/memsql/memsql-spark-connector





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)