Sijie
1.5K posts

Sijie
@sijieg
Co-founder & CEO of @streamnativeio | @apache_pulsar, @asfbookkeeper. In a previous life: @streamlio @twitter @yahoo



StreamNative's Ursa Engine now integrates with @databricks Unity Catalog, bringing real-time streaming to the Lakehouse! ✅ Stream to Iceberg & Delta Lake ✅ Better data governance & AI workflows ✅ Faster, cost-effective real-time analytics hubs.ly/Q0351NYT0 #RealTimeData #Databricks #Lakehouse #AI #Streaming









Hey friends, this tweet is an announcement to our Upstash Kafka users. When we founded Upstash, we identified messaging and task scheduling as the next problems to solve after state management. Initially, we considered Kafka the ideal solution due to its power as a messaging platform. This assumption seems correct as we've received positive feedback for our Kafka offering, and it's financially viable. However, we noticed significant friction for serverless developers using Kafka. Traditional message broker like Kafka is not well-adapted for the serverless use cases. This is why we had to make the difficult decision to halt new Kafka feature development to focus our resources on QStash and Upstash Workflow. Existing users can continue using all platform features, including connectors and the schema registry as normal for the next six months. No immediate action is required because we recognize that a migration plan needs time. After the six month period, we plan to deprecate Upstash Kafka. On the other hand, QStash and, recently, Upstash Workflow naturally evolved into tools specifically for serverless needs. To our surprise, we see an increasing number of customers use QStash for complex business logic orchestration, effectively using it as an alternative to Kafka. This strategic shift allows us to focus on solutions specifically for serverless environments. By focusing our limited resources, we can invest more heavily into QStash and Upstash Workflow. Also, this decision allows us to improve our Redis and Vector offering to provide a more cohesive ecosystem of tools. We want to be fully transparent about our intentions and want to make this transition as easy as possible for our Kafka users. If your Kafka use case can be covered with Upstash QStash, we will cover the entirety of your migration costs. If not, our professional support is always there to help with any of your questions. We appreciate your trust in us and are excited about the future we're building. We believe these changes will ultimately allow us to provide you with a better, more focused solution optimized for serverless. Read the full announcement here: upstash.com/blog/workflow-…

15/ Trying to capture that ecosystem with fragmented, single vendor systems will fail. If you are a vendor, why would you build your connector for a single vendor platform like RedPanda Connect if you could instead target an open standard like Kafka Connect with massive adoption?





🌉For those of you in the SF Bay Area, we're joining forces with @streamnativeio for a meetup on June 20 in Sunnyvale. We’ll have speakers from @PayPal, StreamNative, and @PingCAP along with food and drinks. You can find more details and register for the meetup at meetup.com/real-time-data… 👈

We are thrilled to announce that @databricks and Tabular are joining forces to solve lakehouse interoperability. We intend to work closely across the #ApacheIceberg and #DeltaLake communities to bring open table format compatibility to the #lakehouse. tabular.io/blog/tabular-i…



