A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
Stars
73
Forks
32
Watchers
73
Open Issues
7
Overall repository health assessment
No package.json found
This might not be a Node.js project
changing github owners + adding jenkins file. bypass
a7c82b6View on GitHubRemoving a package thats only available in airflow 1.7.0 so the plugin/operator works in other versions of airflow
d3cb7cfView on GitHubFixing the logic slightly and improving the logging messages. Adding more information to the README.
c090c28View on GitHubFilling out the functionality for the LivySparkOperator. Updating the example dags to fix issues after testing.
a3d2b6aView on GitHubAdding a new Livy Operator. Updating documentation and adding example dags. Updating the spark_test.R script to match the toher workflows. Adding documentation and modifying some things for the SparkSubmitOperator.
fd93745View on GitHub