mehdio
Sep 30, 2021

Sure ! I'm not challenging the fact there are no new features being developed. As I said, I believe it's one of the most active community.

However, the foundation of the current architecture of Airflow was done 6 years ago and we are in a total different landscape today. So having a lot of developed features is nice, but you still carry at the same time quite a legacy.

A practical example I mention in this article is the DAG creation through an API. New tools (AWS step functions/GCP workflows) enable this by design since their first release, and airflow is still stuck atm with a DAG folder than you need to sync somewhere, giving some headaches sometimes.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

mehdio
mehdio

Written by mehdio

✍️ Data Engineering, Tech Career & Code | 🎥 https://www.youtube.com/@mehdio

Responses (1)

Write a response