Denis Magda created IGNITE-7198:
-----------------------------------
Summary: Integrate with Apache Beam
Key: IGNITE-7198
URL:
https://issues.apache.org/jira/browse/IGNITE-7198 Project: Ignite
Issue Type: Task
Reporter: Denis Magda
Fix For: 2.5
Apache Beam (
https://beam.apache.org/) provides a unified API for batch and streaming processing. It can be seen as a generic/portable API with multiple implementations (Spark, Flink, etc.).
Apache Ignite perfectly fits Beam architecture as a Runner:
https://beam.apache.org/contribute/runner-guide/Here is Beam's capability matrix. Let's support as much as we're capable of:
https://beam.apache.org/documentation/runners/capability-matrix/Most likely the integration should go to Beam's repository:
https://github.com/apache/beam/tree/master/runnersDiscussion on the dev list:
http://apache-ignite-developers.2346864.n4.nabble.com/Apache-Ignite-as-a-distributed-processing-back-ends-td25122.html--
This message was sent by Atlassian JIRA
(v6.4.14#64029)