Airflow

What is Airflow?

Airflow is an open source application that gives you the ability to create and orchestrate your data pipelines.

Airflow advantages:

  1. Complex data pipeline can be built using airflow with complex dependencies, retries mechanism and triggering rules.
  2. Cloud vendor Agnostic, i.e works well with all clouds. 

Airflow use cases:

Batch processing data pipelines.

Airflow antipattern use cases:

Real time data pipelines.

Our Airflow Blogs

Airflow use cases