Flyte

🚀 Scale Smarter, Not Harder 🚀 Flyte unifies your data and ML pipelines with cloud-native scalability! ✅ Dynamic workflows adapt to changing needs—no more rigid DAGs. ✅ Cut costs by 80%+ with spot instances—just set interruptible=True. 👉 Learn more: hubs.la/Q036-j2L0

🚀 We're excited to share what's new in Flyte 1.15! Major highlights: 📊 Streaming Decks 🔐 Better Secrets Handling ⚡️ Enhanced Task Caching 📦 Quality of Life Updates Full release notes: hubs.la/Q036ZXkF0 Thanks to 12 new contributors who made this possible! 🙌

- Deeply integrated with Kubernetes - Using AWS-native constructs - Reliable by design This is what the Flyte reference implementation for EKS achieves in minutes using Terraform/OpenTofu. Get started: github.com/unionai-oss/de… Read the blog: hubs.la/Q0364GPH0

@hyperprior @Wooltard Some additional info: #versions" target="_blank" rel="nofollow noopener">docs.flyte.org/en/latest/user… Let us know if that helps

so you can use regular python hints to enforce your pipeline at compile time and also you can use pandera or great expectations to have super granular types and checks on your output data frames not really sure what the immutability means exactly only been using it for a day, unless they mean caching?

I fuck with @flyteorg now it seems

@hyperprior @Wooltard Hey! So the immutability aspect partially has to do with caching but is optional so not completely a system property. By default, every execution gets a version ID that cannot be altered. Also, it instantiates a CRD every time which stores state

🔥Go from hidden states and hard-to-share experiments to reproducible executions. 🚀Tap into elastic compute resources straight from your Notebooks! Learn how Flyte makes it possible: flyte.org/blog/jupyter-n…

🎯 From Notebooks to production with Flyte 1.14. Join us to learn from Flyte maintainers! meetup.com/building-ai-to…

🔥 Learn how to go from zero to production-grade ML orchestration on #Azure: azure.github.io/AKS/2024/11/20… Thanks to @Azure team for their input and feedback; it enabled us to add integrations with Azure Container Insights, AKS node auto-upgrade, and more!

We just reproduced benchmarks of the Liger Kernels package using: - Flyte - One A100 GPU - Phi3 Mini Results? 🔥 Effectively 20% -30% higher token throughput with 6% - 13% less reserved memory compared to vanilla transformers. Dive into the details! flyte.org/blog/reproduci…

🏎️The new reference implementation for @Azure takes you to a production Flyte deployment in minutes, using Terraform/OpenTofu. Learn more: union.ai/blog-post/flyt… Code: github.com/unionai-oss/de…

📢It's today! Join us at 9:00am PT to learn how @LinkedInEng and Enceladus Bio power their ML platforms with Flyte: youtube.com/watch?v=8rbbWZ…

Welcoming Rafael Raposo to Flyte's Technical Steering Committee. We're grateful for @SpotifyEng's support to the project throughout the years, and Rafael's personal commitment to represent our community values. hubs.la/Q02C7FbK0

Welcoming Rafael Raposo to Flyte's Technical Steering Committee. We're grateful for @SpotifyEng's support to the project throughout the years, and Rafael's personal commitment to represent our community values. hubs.la/Q02C7zjH0

Our next Community sync will include 2 🔥 sessions: 1️⃣9:00 - 9:30 am PT How @go_brain_space uses Flyte to develop a new breed of models 🧠 2️⃣9:30 - 10:00 am PT 💥Live demo of @union_ai's Serverless platform +Q&A moderated by @kelseyhightower! Register: bit.ly/enablemlops

Special mention to Greg Gydush, Robert Deaton, Roger Torrentsgenerós and Jason Parraga for their continued support and contributions to Flyte!

Brian Chen for adding prefetch functionality to the paginator. github.com/flyteorg/flyte…

✨ Monthly Contributors Spotlight ✨ A huge shoutout to our contributors of the month: Austin Liu, Tom Newton, Rafael Raposo and Brian Chen 👏