Apache Beam
≈ 1 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. Beam Pipelines are defined using one of the provided SDKs and executed in one of the Beam's supported runners (distributed processing back-ends) including Apache Flink, Apache Samza, Apache Spark, and Google Cloud Dataflow.
Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. Beam Pipelines are defined using one of the provided SDKs and executed in one of the Beam's supported runners (distributed processing back-ends) including Apache Flink, Apache Samza, Apache Spark, and Google Cloud Dataflow.
History
Apache Beam is one implementation of the Dataflow model paper. The Dataflow model is based on previous work on distributed processing abstractions at Google, in particular on FlumeJava and Millwheel. Google released an open SDK implementation of the Dataflow model in 20141 and an environment to execute Dataflows locally (non-distributed) as well as in the Google Cloud Platform service.
Timeline
Apache Beam makes minor releases every 6 weeks.
See also
List of Apache Software Foundation projects
References
Text derived from https://en.wikipedia.org/w/index.php?oldid=1372450105 under CC BY-SA 4.0; modifications have been made.
References
- ↩Wikipedia “Apache Beam” release date (×1) · confidence 0.95 revision URL