Zander

We’ve been working hard to make a better way to work with streaming data and today we’re sharing it with the world. Announcing Bytewax - a stream processing framework. 👐 Open source 🐍 Python native 🚀 Highly scalable 🌩️ Cloud native 🎉 bytewax.io/blog/bytewax/ 🎉

🎯 “Operationalizing RAG: From batch processing to real-time APIs” As part of our ongoing exploration into 𝐑𝐞𝐭𝐫𝐢𝐞𝐯𝐚𝐥-𝐀𝐮𝐠𝐦𝐞𝐧𝐭𝐞𝐝 𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐨𝐧 (𝐑𝐀𝐆), we’re tackling one of the biggest challenges of 2025: bringing RAG workflows to real-time applications. 𝐓𝐡𝐞 𝐩𝐫𝐨𝐛𝐥𝐞𝐦: Many systems rely on outdated batch processes that just can’t keep up. 𝐓𝐡𝐞 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧: A pipeline powered by Bytewax, @FastAPI, and Haystack by @deepset_ai, delivering scalable APIs that provide instant insights. 𝐖𝐡𝐚𝐭’𝐬 𝐢𝐧𝐬𝐢𝐝𝐞 𝐭𝐡𝐞 𝐚𝐫𝐭𝐢𝐜𝐥𝐞: ✅ How to integrate Bytewax for high-speed indexing of streaming data. ✅ Using FastAPI to expose RAG workflows via efficient, scalable endpoints. ✅ Leveraging Haystack by deepset for flexible and dynamic retrieval and embedding pipelines. ✅ Practical use cases for transforming your AI stack with real-time data processing. 📌 “AI systems grounded in real-time, relevant data are more accurate, reliable, and impactful.” Check it out here ➡️ bytewax.io/blog/rag-app-c…

𝐌𝐨𝐝𝐮𝐥𝐞𝐬 𝐀𝐋𝐄𝐑𝐓! 🚨 Let’s be honest—data engineering is full of bottlenecks. Building custom connectors, writing boilerplate code, debugging integrations… it’s the work no one wants, but everyone needs. That’s exactly why we launched the Module Hub. It’s not just a toolset; it’s a smarter way of thinking about real-time pipelines. "𝘚𝘵𝘰𝘱 𝘥𝘰𝘪𝘯𝘨 𝘵𝘩𝘦 𝘴𝘢𝘮𝘦 𝘵𝘩𝘪𝘯𝘨𝘴 𝘰𝘷𝘦𝘳 𝘢𝘯𝘥 𝘰𝘷𝘦𝘳. 𝘚𝘵𝘢𝘳𝘵 𝘧𝘰𝘤𝘶𝘴𝘪𝘯𝘨 𝘰𝘯 𝘸𝘩𝘢𝘵 𝘳𝘦𝘢𝘭𝘭𝘺 𝘮𝘢𝘵𝘵𝘦𝘳𝘴." That’s what our CEO, @MathesonZander, envisions for every team using Bytewax. 🔥 These are the incredible companies whose technologies power the new Bytewax modules — find all the details in our blog. 🔗 bytewax.io/blog/bytewax-o… @apachekafka , Google BigQuery, @hopsworks FS, AWS Kinesis Streams, @ClickHouseDB, @MongoDB, @MQTT, @DeltaLakeOSS, @RabbitMQ, AWS IoT Gateway, Azure IoT Data Hub, @redpandadata, Amazon MSK, @confluentinc, @Redisinc, Websockets, @SnowflakeDB, @qdrant_engine, @milvusio, @pinecone, Oracle MySQL, Google Vertex AI, Amazon SageMaker, Feast, Weaviate, @InfluxDB, Microsoft @Azure AI Search, and more.

𝐁𝐲𝐭𝐞𝐰𝐚𝐱 𝐚𝐭 𝐏𝐲𝐃𝐚𝐭𝐚 𝐍𝐘𝐂: 𝐍𝐨 𝐓𝐫𝐢𝐜𝐤𝐬, 𝐉𝐮𝐬𝐭 𝐑𝐮𝐬𝐭𝐲 𝐏𝐲𝐭𝐡𝐨𝐧 𝐓𝐫𝐞𝐚𝐭𝐬! Happy Halloween, everyone! 🎃 We're thrilled to announce that Bytewax will be at @PyData NYC by @NumFOCUS from November 7th to 8th, sharing what makes real-time data streaming in Python 𝐬𝐜𝐚𝐥𝐚𝐛𝐥𝐞, 𝐟𝐚𝐬𝐭, and 𝐞𝐟𝐟𝐢𝐜𝐢𝐞𝐧𝐭! Our own @MathesonZander will explore the “spooky” secrets behind Bytewax’s core technology. His talk will explain 𝘸𝘩𝘺 𝘙𝘶𝘴𝘵 𝘱𝘰𝘸𝘦𝘳𝘴 𝘰𝘶𝘳 𝘦𝘯𝘨𝘪𝘯𝘦, 𝘦𝘹𝘱𝘭𝘰𝘳𝘪𝘯𝘨 𝘗𝘺𝘖3 𝘢𝘯𝘥 𝘩𝘰𝘸 𝘙𝘶𝘴𝘵 𝘮𝘢𝘬𝘦𝘴 𝘗𝘺𝘵𝘩𝘰𝘯 𝘧𝘢𝘴𝘵𝘦𝘳 (no black magic needed!). Curious about how to “oxidize” your Python code? Be there to find out! Swing by our booth to grab some Bytewax 🐝 swag and chat with our team about Python, Rust, and all things streaming tech. We can't wait to see you there! P.S. We've got another video gem from @MathesonZander! A must-watch—but maybe not for the easily moved. 😁 Enjoy!

"Exo's use of Llama 405B and consumer-grade devices to run inference at scale on the edge shows that the future of AI is open source and decentralized." - @mo_baioumy x.com/ac_crypto/stat…

🤫 Looking for some fresh insights on #Kafka and an in-person chat? We’ve got you covered! 😎 Join us on September 16 for a free meetup in Austin hosted by @lensesio. We’ll discuss modern Kafka applications, from Customer 360 and real-time AI to data streaming solutions for enterprises. Speakers from @SASsoftware and @ShadowTrafficIO will share how they’re leveraging Kafka to accelerate development, implement ML/AI, and enhance stream processing. Our own @MathesonZander 🐝 will discuss the growing impact of streaming data in ML/AI, explore system architecture, share a real-world case study, and showcase a Bytewax demo on creating real-time machine learning systems. Let’s catch up, share insights, and stay ahead in the world of data streaming! ✨ RSVP ➡️ bytewax.io/events/meetup-…