We’ve build out pre-configured Docker containers w/ Celery and metrics/monitoring. The Astronomer Airflow module consists of seven components, and you must bring your own Postgres and Redis database.
This kit is fully open-sourced (Apache 2.0) and you can experiment with it at https://open.astronomer.io/.
We also make it easy to use the Airflow CLI remotely (i.e. run commands from your local terminal that execute in the cloud Airflow).
Astronomer Enterprise makes it easy to deploy these containers to Kubernetes - but more importantly, to give Airflow developers a CLI to deploy DAGs through a private Docker registry that interacts with the Kubernetes API.
Commander glues this all together.
Remember to run
astro airflow init after creating a new project directory.
Any Python packages can be added to
requirements.txt and all OS level packages can be added to
packages.txt in the project directory.