Airflow brought one of the best tools with nice UI for running pipelines back in 2014-2016. But now days engineers should be aware about easier to use options and don’t choose Airflow blindly as default choice.
IMHO for 80-90% of cases orchestration system should not use code at all - it should be DAGs as a config code. Airflow is popular and teams keep choosing it for building simple DAGs and incurring avoidable otherwise Airflow maintenance costs.
Databricks Orchestration pipeline, AWS Step Functions - good examples of DAGs as a configuration.
Databricks Orchestration pipeline, AWS Step Functions - good examples of DAGs as a configuration.