Gregor

314 posts

Gregor banner
Gregor

Gregor

@gr2m

Building the @aiSDK.

Los Angeles Katılım Ocak 2008
49 Takip Edilen4.1K Takipçiler
Sabitlenmiş Tweet
Gregor
Gregor@gr2m·
📢 I'm really excited to share that I'm back to working on Open Source, an SDK no less! And not any SDK, but @aiSDK! Thank you @vercel for letting me 🖤 I'll be using Twitter exclusively for work.
English
8
1
96
7.8K
Gregor retweetledi
Guillermo Rauch
Guillermo Rauch@rauchg·
We've hit 10,000,000 weekly @aisdk downloads 🤯 𝚗𝚙𝚖 𝚒 𝚊𝚒 is all you need. One package, any model.
Guillermo Rauch tweet media
English
75
28
739
44.7K
Nico Albanese
Nico Albanese@nicoalbanese10·
Writing code by hand today, very strange
English
6
0
19
1.7K
Gregor retweetledi
Gregor retweetledi
John McBride
John McBride@johncodes·
🧃 Introducing stereOS: a Linux based operating system hardened and purpose built for AI agents. It's clear that agents need an ACTUAL operating system (not what people are calling an "OS") to witness the full breadth and depth of their capabilities while mitigating the blast radius of autonomous, untrusted actors. But there are so many problems with AI sandboxes today: * Going out to the apple store and buying a mac mini will never scale and is way too expensive (obviously) * Running in Docker is too restrictive (agents can't stand up their own container infrastructure, no sub virtualization, docker-in-docker is very broken) * Firecracker strips all the hardware so GPU PCIe passthrough, secure boot, FIPs, etc. is out of the question. * Native VMs are too fat and the overhead of 1 agent per VM is too much. stereOS takes a different approach: it's a full NixOS system that you boot and then kick off agent sandboxes inside with gVisor + /nix/store namespace mounting. Each agent gets their own kernel and the /nix/store is read only by nature. Even if the agent was somehow able to escape the gVisor virtual kernel, they'd land on the NixOS system as the "agent" user! Not your actual hardware!! If you want to take a defense-in-depth approach, we support "native" agents that run at the system level kicked off by our `agentd` utility. These agents, on their own, can manage and kick off other sub agents using the internal sandboxing mechanisms. Today, we're open sourcing all of this: * stereOS: our purpose built Linux OS - github.com/papercomputeco… * masterblaster: client utility to launch, manage, and orchestrate agents - github.com/papercomputeco… * stereosd: the stereOS system control plane daemon - github.com/papercomputeco… * agentd: the stereOS system agent management daemon - github.com/papercomputeco… Give it a try, throw us a star, and let me know what you think 🧃⭐️
English
161
244
1.9K
147.6K
Gregor retweetledi
Felix Arntz
Felix Arntz@felixarntz·
Gemini Nano Banana models have been supported in @aisdk for a while, but as of recently you can use them more intuitively, via `generateImage`.
Felix Arntz tweet media
English
3
2
11
855
Gregor
Gregor@gr2m·
@threepointone Sure! I tried that first but run into problems so pivoted due to time constraints. Happy to give it another go, and always prefer to collab
English
1
0
5
552
sunil pai
sunil pai@threepointone·
@gr2m Will do! would you be open to a PR that uses a native Websocket instead of import('ws')? Then I could probably drop my fork altogether
English
2
0
7
7.4K
Gregor
Gregor@gr2m·
@zo0r @aisdk not yet > No multiplexing support today. Use multiple connections if you need parallel runs. #connection-behavior-and-limits" target="_blank" rel="nofollow noopener">developers.openai.com/api/docs/guide…
English
1
0
1
177
Jorge Trujillo
Jorge Trujillo@zo0r·
@aisdk how can i reuse the same socket with multiple streamText?
English
2
0
0
1.3K
SebastianBoo
SebastianBoo@SebastianB929·
@aisdk Great! Will you be supporting also the realtime audio models?
English
1
0
0
1K
Gregor
Gregor@gr2m·
And docs: #websocket-transport" target="_blank" rel="nofollow noopener">ai-sdk.dev/providers/ai-s…
English
0
0
1
94
Gregor retweetledi
Chris Cook
Chris Cook@zirkelc_·
Introducing `ai-resumable-stream` for @aisdk I have stuffed everything I learned about resuming/stopping UI message streams into a small package Fully tested against `streamText` and a locally running Redis database A simple API with just three functions: start, resume, stop
Chris Cook tweet media
English
14
11
239
11.8K
Javi
Javi@jvrsanch·
Hey @gr2m @rauchg Are stream resumption + with abort gonna be available soon (<1 month)?
Javi tweet media
English
1
0
0
292