Apache Airflow

What if your @ApacheAirflow task asked an LLM whether the error is retryable before wasting 3 blind retries? Landing in Airflow 3.3. (AIP-105) 🧵

We will no longer be posting to this site. Please follow us on @airflow" target="_blank" rel="nofollow noopener">fosstodon.org/@airflow

🚀 Chicago Airflow Meetup! 🚀 Join us @ Fulton Street Collective on March 20 for talks on Airflow 3 & ML, great convo, & exclusive swag! 🎉 📅 5:30–8 PM CT 🔗 RSVP: meetup.com/chicago-apache… #AirflowMeetup #DataEngineering

🚀 The Annual Airflow Survey is here! 5K+ data pros shared how they use Apache Airflow to power AI, revenue & more. 📈 90%+ recommend Airflow 📥 Downloads: 900K → 31M+/mo since 2020 🔜 Biggest update ever coming this Spring! 📊 Read the report: airflow.apache.org/blog/airflow-s…

Airflow Summit 2025 CFP is open! We want to hear your stories, best practices & use cases around @ApacheAirflow 🗓️ Join us in Seattle, Oct 7-9, 2025. 🎟️ Plus, Super Early Bird registration is live, save 35%!🔗 CFP: sessionize.com/airflow-summit… 🔗 Tickets: airflowsummit.org/tickets/

We've just released Apache Airflow 2.10.5 🎉 📦 PyPI: pypi.org/project/apache… 📚 Docs: airflow.apache.org/docs/apache-ai… 🛠 Release Notes: airflow.apache.org/docs/apache-ai… 🐳 Docker Image: "docker pull apache/airflow:2.10.5" Thanks to all the contributors who made this possible.

💌 Airflow Summit is back in 2025 and the Super Early Bird registration is now open Join the global @ApacheAirflow community in Seattle from October 7-9 to learn from the experts all about Airflow 3.0. 📷 Save your spot at the best rate (35% discount): airflowsummit.org/tickets/

We've just released Apache Airflow 2.10.4 🎉 📦 PyPI: pypi.org/project/apache… 📚 Docs: airflow.apache.org/docs/apache-ai… 🛠 Release Notes: airflow.apache.org/docs/apache-ai… 🐳 Docker Image: "docker pull apache/airflow:2.10.4" Thanks to all the contributors who made this possible.

2 Weeks left to complete the Airflow Survey! Complete the Survey to Get: 💰 Free Airflow Fundamentals or DAG Authoring Cert(valued at $150 each) 🏆 Entry into a raffle for a complimentary workshop with Airflow expert Marc Lamberti astronomer.typeform.com/airflowsurvey24

We've just released Apache Airflow 2.10.3 🎉 📦 PyPI: pypi.org/project/apache… 📚 Docs: airflow.apache.org/docs/apache-ai… 🛠 Release Notes: airflow.apache.org/docs/apache-ai… 🐳 Docker Image: "docker pull apache/airflow:2.10.3" Thanks to all the contributors who made this possible.

The Airflow Survey is HERE! Take the survey now to receive: 1️⃣ Free Airflow Fundamentals Certification ($150 value) 2️⃣ Free DAG Authoring Certification ($150 value 3️⃣ Enter a raffle for a DAG Authoring Best Practices Workshop w/ Marc Lamberti astronomer.typeform.com/airflowsurvey24

🚀 We’re thrilled to welcome Vikram Koka (@vikramvkoka) as a new PMC member for Apache Airflow! 🎉 Congrats, Vikram! 👏

We've just released Apache Airflow 2.10.2 🎉 📦 PyPI: pypi.org/project/apache… 📚 Docs: airflow.apache.org/docs/apache-ai… 🛠 Release Notes: airflow.apache.org/docs/apache-ai… 🐳 Docker Image: "docker pull apache/airflow:2.10.2" Thanks to all the contributors who made this possible.

Really neat listening to Ford's data engineering team talk about how they use @astronomerio to power advanced driver-assistance systems (ADAS) this morning at @ApacheAirflow Summit

"Airflow is the heart of our platform." LinkedIn team discussing how they built the company's Continuous Deployment platform at @ApacheAirflow Summit

@Rangers in #airflowsummit2024 @ApacheAirflow world champions data engineers 🧑‍💻 ⚾️

We are ready for Airflow 3.0 !!! 🙌👏@apacheairflow #airfowsummit2024 #10yearsofairflow

The Chief Strategy Officer at @astronomerio announcing @ApacheAirflow 3.0 with the project now having more contributors than #spark and #kafka

Running airflow in any language! 🤯 @ApacheAirflow @AirflowSummit