Bookujima
8.1K posts

Bookujima
@bookujima
Caramel On The Rock Americano with Sumatra Coffee. OSS 🇮🇩



I’m honoured to be joining 𝕏 to lead design. I believe this is the most important platform in the world, and I can’t think of a more exciting place to help shape the future. I’m looking forward to working closely with @elonmusk, @nikitabier, and the rest of the team. I’m grateful for the opportunity, humbled to be part of it, and can't wait to get started!

Introducing TurboQuant: Our new compression algorithm that reduces LLM key-value cache memory by at least 6x and delivers up to 8x speedup, all with zero accuracy loss, redefining AI efficiency. Read the blog to learn how it achieves these results: goo.gle/4bsq2qI



LiteLLM HAS BEEN COMPROMISED, DO NOT UPDATE. We just discovered that LiteLLM pypi release 1.82.8. It has been compromised, it contains litellm_init.pth with base64 encoded instructions to send all the credentials it can find to remote server + self-replicate. link below


















