[jira] [Created] (IGNITE-7198) Integrate with Apache Beam

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (IGNITE-7198) Integrate with Apache Beam

Anton Vinogradov (Jira)
Denis Magda created IGNITE-7198:
-----------------------------------

             Summary: Integrate with Apache Beam
                 Key: IGNITE-7198
                 URL: https://issues.apache.org/jira/browse/IGNITE-7198
             Project: Ignite
          Issue Type: Task
            Reporter: Denis Magda
             Fix For: 2.5


Apache Beam (https://beam.apache.org/) provides a unified API for batch and streaming processing. It can be seen as a generic/portable API with multiple implementations (Spark, Flink, etc.).

Apache Ignite perfectly fits Beam architecture as a Runner:
https://beam.apache.org/contribute/runner-guide/

Here is Beam's capability matrix. Let's support as much as we're capable of:
https://beam.apache.org/documentation/runners/capability-matrix/

Most likely the integration should go to Beam's repository:
https://github.com/apache/beam/tree/master/runners

Discussion on the dev list: http://apache-ignite-developers.2346864.n4.nabble.com/Apache-Ignite-as-a-distributed-processing-back-ends-td25122.html



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)