Apache Airflow (@ApacheAirflow) header
Apache Airflow (@ApacheAirflow) profile picture

Apache Airflow

@ApacheAirflow

Airflow is a workflow scheduler. Now on https://teapaw.org/t.co/r5iMFW0E2h

airflow.apache.org/
Joined April 2016
  • Tweets1.5K
  • Following0
  • Followers12.1K
239Media
Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)Photo by Apache Airflow (@ApacheAirflow)
Apache Airflow retweeted
Kaxil Naik (@kaxil) profile picture
Kaxil Naik@kaxilOct 20
Replying to @kaxil @pydantic
Full post, with every Dag we ran: airflow.apache.org/blog/comm… 38 people built this between April and October. Thank you all 🙏

Airflow AI Provider 1.0: Agents, Sandboxes, Human Approval and Smarter Retries

Apache Airflow's Common AI provider reaches 1.0 and installs on Airflow 2.11. On Airflow 3.3, agents can wait for a person to approve a tool call, and a model can decide whether a failed task retries.

airflow.apache.org
1
1
122
Apache Airflow retweeted
Kaxil Naik (@kaxil) profile picture
Kaxil Naik@kaxilOct 20
Replying to @kaxil @pydantic
Retry policies work with Jev-like Decision models on any task, AI or not: a model reads the error and decides whether to retry or fail now. A revoked key failed at once instead of burning 3 retries. A 429 retried 60s later and passed.
Image from Kaxil Naik (@kaxil)
1
1
2
156
Apache Airflow retweeted
Kaxil Naik (@kaxil) profile picture
Kaxil Naik@kaxilOct 20
Already have agents? OpenAI Agents SDK, Strands, Google ADK and the Anthropic SDK get the same Airflow toolsets as the built-in @Pydantic AI operators.
Image from Kaxil Naik (@kaxil)
1
2
3
333
Apache Airflow retweeted
Kaxil Naik (@kaxil) profile picture
Kaxil Naik@kaxilOct 20
📣📢 Airflow AI Provider 1.0 is out. AI agents as @ApacheAirflow tasks, with your warehouses, buckets and APIs as their tools. The model never sees a credential. Any agent framework, approval before it acts, smarter retries, and it runs on Airflow 2.11+ 🧵
Image from Kaxil Naik (@kaxil)
2
2
4
241
We will no longer be posting to this site. Please follow us on fosstodon.org/@airflow
16
4
53
9,132
🚀 Chicago Airflow Meetup! 🚀 Join us @ Fulton Street Collective on March 20 for talks on Airflow 3 & ML, great convo, & exclusive swag! 🎉 📅 5:30–8 PM CT 🔗 RSVP: meetup.com/chicago-apache-ai… #AirflowMeetup #DataEngineering
Image from Apache Airflow (@ApacheAirflow)
1
10
2,780
🚀 The Annual Airflow Survey is here! 5K+ data pros shared how they use Apache Airflow to power AI, revenue & more. 📈 90%+ recommend Airflow 📥 Downloads: 900K → 31M+/mo since 2020 🔜 Biggest update ever coming this Spring! 📊 Read the report: airflow.apache.org/blog/airf…
Image from Apache Airflow (@ApacheAirflow)
1
11
1,915
Airflow Summit 2025 CFP is open! We want to hear your stories, best practices & use cases around @ApacheAirflow 🗓️ Join us in Seattle, Oct 7-9, 2025. 🎟️ Plus, Super Early Bird registration is live, save 35%!🔗 CFP: sessionize.com/airflow-summi… 🔗 Tickets: airflowsummit.org/tickets/
Image from Airflow Summit (@AirflowSummit)
1
1
5
1,165
We've just released Apache Airflow 2.10.5 🎉 📦 PyPI: pypi.org/project/apache-airf… 📚 Docs: airflow.apache.org/docs/apac… 🛠 Release Notes: airflow.apache.org/docs/apac… 🐳 Docker Image: "docker pull apache/airflow:2.10.5" Thanks to all the contributors who made this possible.
Image from Apache Airflow (@ApacheAirflow)
1
5
55
2,605
💌 Airflow Summit is back in 2025 and the Super Early Bird registration is now open Join the global @ApacheAirflow community in Seattle from October 7-9 to learn from the experts all about Airflow 3.0. 📷 Save your spot at the best rate (35% discount): airflowsummit.org/tickets/
Image from Airflow Summit (@AirflowSummit)
2
6
998
We've just released Apache Airflow 2.10.4 🎉 📦 PyPI: pypi.org/project/apache-airf… 📚 Docs: airflow.apache.org/docs/apac… 🛠 Release Notes: airflow.apache.org/docs/apac… 🐳 Docker Image: "docker pull apache/airflow:2.10.4" Thanks to all the contributors who made this possible.
Image from Apache Airflow (@ApacheAirflow)
2
13
44
3,010
2 Weeks left to complete the Airflow Survey! Complete the Survey to Get: 💰 Free Airflow Fundamentals or DAG Authoring Cert(valued at $150 each) 🏆 Entry into a raffle for a complimentary workshop with Airflow expert Marc Lamberti astronomer.typeform.com/airf…
Image from Apache Airflow (@ApacheAirflow)
1
8
1,477
We've just released Apache Airflow 2.10.3 🎉 📦 PyPI: pypi.org/project/apache-airf… 📚 Docs: airflow.apache.org/docs/apac… 🛠 Release Notes: airflow.apache.org/docs/apac… 🐳 Docker Image: "docker pull apache/airflow:2.10.3" Thanks to all the contributors who made this possible.
Image from Apache Airflow (@ApacheAirflow)
5
36
2,239
The Airflow Survey is HERE! Take the survey now to receive: 1️⃣ Free Airflow Fundamentals Certification ($150 value) 2️⃣ Free DAG Authoring Certification ($150 value 3️⃣ Enter a raffle for a DAG Authoring Best Practices Workshop w/ Marc Lamberti astronomer.typeform.com/airf…
Image from Apache Airflow (@ApacheAirflow)
1
2
8
1,653
🚀 We’re thrilled to welcome Vikram Koka (@vikramvkoka) as a new PMC member for Apache Airflow! 🎉 Congrats, Vikram! 👏
1
2
18
1,492
We've just released Apache Airflow 2.10.2 🎉 📦 PyPI: pypi.org/project/apache-airf… 📚 Docs: airflow.apache.org/docs/apac… 🛠 Release Notes: airflow.apache.org/docs/apac… 🐳 Docker Image: "docker pull apache/airflow:2.10.2" Thanks to all the contributors who made this possible.
Image from Apache Airflow (@ApacheAirflow)
1
6
23
1,980
Apache Airflow retweeted
Mark Wheeler (@Marky_At_Work) profile picture
Mark Wheeler@Marky_At_Work11 Sep 2024
Really neat listening to Ford's data engineering team talk about how they use @astronomerio to power advanced driver-assistance systems (ADAS) this morning at @ApacheAirflow Summit
1
5
968
Apache Airflow retweeted
Mark Wheeler (@Marky_At_Work) profile picture
Mark Wheeler@Marky_At_Work12 Sep 2024
"Airflow is the heart of our platform." LinkedIn team discussing how they built the company's Continuous Deployment platform at @ApacheAirflow Summit
2
3
952
Replying to @Rangers
@Rangers in #airflowsummit2024 @ApacheAirflow world champions data engineers 🧑‍💻 ⚾️
Image from Florecita rockera 🇺🇦 (@marayve)
Image from Florecita rockera 🇺🇦 (@marayve)
1
3
780
We are ready for Airflow 3.0 !!! 🙌👏@apacheairflow #airfowsummit2024 #10yearsofairflow
Image from Florecita rockera 🇺🇦 (@marayve)
Image from Florecita rockera 🇺🇦 (@marayve)
Image from Florecita rockera 🇺🇦 (@marayve)
1
1
1
3
829
Load more