bakdata

The latest KPOps release now supports #ArgoCD, bridging the gap between Streams Pipeline definition & delivery. Render pipelines as plain K8s manifests or for ArgoCD! Happy holidays & a smooth end of 2024! 🎄✨ #ApacheKafka #KafkaStreams #Kubernetes bakdata.github.io/kpops/9.0/

New on the blog: Harnessing Interactive Queries V2 in #KafkaStreams ! Dive into our practical guide and discover the power of queries and state stores for real-time insights and scalable analytics. #ApacheKafka #DataStreaming medium.com/bakdata/harnes…

Thanks to yesterday’s @ApacheKafka Meetup visitors in Munich, the host apinity GmbH and the speakers @BrunoCadonna, Ajinkya Khalwadekar and @RaminGharib for making it such insightful discussion on versioned state.

Pretty cool talk by Torben Meyer from @bakdata at #KafkaSummit London. "Towards Global State in Kafka Streams" confluent.io/events/kafka-s… Stay CALM an carry on... dl.acm.org/doi/10.1145/33…

You can now replay the manifold input we enjoyed at #KafkaSummit London. Thanks to all contributors/organizers. Check out our work on graphs from streams and how to tweak global state in #kafkastreams. confluent.io/resources/gene…

Up next at #KafkaSummit is @bakdata. I really enjoying seeing the streaming efforts done at bakdata the past few years. @jakobedding

Approaching #KafkaSummit London 2024. Looking forward to exchange and discuss about #KafkaStreams & @ApacheKafka. Torben will talk about maintaining global state for Kafka Streams applications. Jakob will present his & Philipp’s work on #KnowledgeGraphs from data streams.

#KafkaSummit is coming to London and Bangalore in 2024. CfP for both are open (London until Nov/27, Bangalore until Jan/10), so you can submit your talks now! Hope to see you there! kafka-summit.org

Our latest blogpost guides you through the creation of stream data pipelines consisting of @apachekafka producers/consumers, @kafkastreams apps and connectors. Learn how open-source KPOps, simplifies the management of such pipelines on #Kubernetes. medium.com/bakdata/introd…

It's been a pleasure to host yesterday's meetup and introduce KPOps to manage @ApacheKafka pipelines on #Kubernetes. Thanks to all guests and @davidmoravek and @jansvoboda for their talks on @ApacheFlink.

Seems @kafkastreams is on 🔥 recently! - KIP-960: IQ for versioned-stores - KIP-955: stream-table FK-join (🤔) - KIP-954: custom stores for DSL default store config - KIP-941: allow `null` for IQ range queries - KIP-892: TX stores - KIP-759: repartition canceling Way to go!

Super interesting talk from Torbin about how @bakdata auto scales @kafkastreams for ML use cases #KafkaSummit

Just wrapped up my talk at #KafkaSummit on implementing real-time analytics with Kafka Streams! 🚀 Sharing insights and strategies to unlock the power of real-time data processing. #RealTimeAnalytics #ApacheKafka @bakdata @apachekafka @kafkastreams kafka-summit.org/sessions/imple…

Join me at #KafkaSummit next week as I discuss implementing real-time analytics with Kafka Streams! kafka-summit.org/sessions/imple… #ApacheKafka #streamprocessing #analytics #Kafka @confluentinc @kafkastreams @bakdata

It felt great to have our first company retreat in three years and exchange on #ApacheKafka, #Kubernetes, and beyond.

@jbfletch_ We try our best to keep distributed state on instances as small as possible ≪ 1 TB. Especially to keep data in RAM. Whenever possible, we avoid global state. Across instances, we also reach the TB limit for state stores. #KafkaStreams #ApacheKafka

Would love to know what @bakdata has seen 😁

Question for the @kafkastreams community, what is the largest state store (both sharded and summation of shards along with # of partitions) you have ever seen? I've seen way over one TB per instance but I'm curious what the max for others might be.

We released KPOps v1.0.0! Define complex stream data pipelines consisting of multiple interconnected @kafkastreams applications, @apachekafka Producers/Consumers, and Kafka Connectors in a lean way and deploy them to #Kubernetes github.com/bakdata/kpops

The #KafkaSummit London agenda is LIVE! Join us for ✅ Visionary keynote sessions ✅ 65+ technical sessions and lightning talks ✅ Hackathon ✅ and so much MORE Get the full list of speakers & sessions to see what’s in store at Kafka Summit ➡️ cnfl.io/3xI3Jsn

@apachekafka @kafkastreams Torben will present "Timely Auto-Scaling of Kafka Streams Pipelines with Remotely Connected APIs" and @ramingharib will show how we are "Implementing Real-Time Analytics with Kafka Streams".

We're going to London! We will give two talks at this year's #KafkaSummit. See you there! @apachekafka @kafkastreams