Thom

169 posts

Thom

Thom

@ThomShutt

England Katılım Mart 2022
306 Takip Edilen155 Takipçiler
habitual line stepper
habitual line stepper@jojobreeeeze·
@madisontayt_ We both know there’s only one real test. I lost access to my crypto wallet, can anyone help me recover it? 0x283728283738228
English
2
0
57
15K
Thom retweetledi
RyanOnTheInside
RyanOnTheInside@RyanOnTheInside·
YO, I adapted VACE to work with real-time autoregressive video generation. Here's what it can do right now in real time: - Depth, pose, optical flow, scribble, edge maps — all the v2v control stuff - First frame animation / last frame lead-in / keyframe interpolation - Inpainting with static or dynamic masks - Stacking stuff together (e.g. depth + LoRA, inpainting + reference images) - Reference-to-video is in there too but quality isn't great yet compared to batch Getting ~20 fps for most control modes on a 5090 at 368x640 with the 1.3B models. Image-to-video hits ~28 fps. Works with 14b models as well, but doesnt fit on 5090 with VACE. This is all part of Daydream Scope, an open source tool for running real-time interactive video generation pipelines. The demos were created in/with Scope, and is a combination of Longlive, VACE, and Custom LoRA. There's also a very early WIP ComfyUI node pack wrapping Scope. But how is a real-time, autoregressive model relevant to @ComfyUI ? Ultra long video generation. You can use these models distilled from Wan to do V2V tasks on thousands of frames at once, technically infinite length. I havent experimented much more than validating the concept on a couple thousand frames gen. It works! Full technical details on real-time VACE + more examples here (link in comments) Curious what people think. Happy to answer questions. Video + Custom LoRA links also in comments. Love, Ryan p.s. I will be back with a sick update on ACEStep implementation tomorrow (links in first comment)
English
13
16
103
10.9K
Thom retweetledi
Daydream
Daydream@DaydreamLiveAI·
We adapted VACE for real-time autoregressive video generation. Depth, pose, inpainting, temporal extension, reference-to-video, all composable. 20+ FPS. No retraining needed.
English
10
3
27
2.4K
Thom retweetledi
Daydream
Daydream@DaydreamLiveAI·
Daydream Cohort kicked off today. The #2 Interactive AI Video Program is rolling. Keep an 👁️ out for their creations.
Daydream tweet media
English
0
4
10
225
Thom
Thom@ThomShutt·
Reading things in 2026
Thom tweet mediaThom tweet mediaThom tweet mediaThom tweet media
English
2
1
3
166
Thom retweetledi
Daydream
Daydream@DaydreamLiveAI·
Feb 9–20. One curated cohort. Dedicated mentorship. 🪂 Who's ready?
English
1
7
20
2.8K
Thom retweetledi
Daydream
Daydream@DaydreamLiveAI·
In this new post from @MarcoTundo, read how we tried to teach StreamDiffusion V2 to do image-to-video (I2V). Two “promising” ideas imploded before a third finally worked. app.daydream.live/creators/smart…
English
1
5
8
936
Thom
Thom@ThomShutt·
I'm going to be here to talk about the work we've been doing on @DaydreamLiveAI tomorrow - come and say hi!
Encode Club@encodeclub

Join @StoryProtocol & @Livepeer this Friday at Encode Hub for coworking + a hands-on creative video AI workshop! ꩜ 12–3pm: Coworking, feedback, 1:1s w/ Nick from Story ꩜ 3–5pm: Workshop w/ Jamie (Sound of Fractures) Learn to use AI to craft intentional content + videos - not generic ones. You’ll map your story, find themes, and turn ideas into real outputs. RSVP now ↓

English
0
0
1
33
Thom
Thom@ThomShutt·
Sad to not be making it to @demuxed this year, but everyone should check out @RafalLeszko talking about the work we've been doing with realtime generative AI!
Thom tweet media
English
0
0
2
56
Thom retweetledi
Yondon Fu
Yondon Fu@YondonFu·
Excited to support StreamDiffusionV2 in the latest release of Scope today! As a reminder, Scope is tool for running and customizing real-time, interactive generative AI pipelines and models. Here is a walkthrough of it in action in Scope (see next post if you just want the demo) running on a 4090 at ~9 fps and 512x512 resolution:
Chenfeng_X@Chenfeng_X

🥳We’re releasing StreamDiffusionV2 for the live-stream community—from individual creators with one GPU to enterprise platforms with many. StreamDiffusionV2 is our follow-up to StreamDiffusion: #StreamDiffusion powered real products, but temporal consistency still bugged us. We’re fixing that for the community: 🤔Efficiency ≠ live-readiness: many “real-time” video diffusion models are fast, but live streaming demands per-frame deadlines with low jitter. StreamDiffusionV2 balances temporal stability with strict per-frame deadlines, achieves fast interaction, and is ready for your AI Youtuber Stream Live👇 📒Project page: streamdiffusionv2.github.io 💻Code: github.com/chenfengxu714/…

English
6
14
23
4.1K
Thom retweetledi
Chenfeng_X
Chenfeng_X@Chenfeng_X·
🥳We’re releasing StreamDiffusionV2 for the live-stream community—from individual creators with one GPU to enterprise platforms with many. StreamDiffusionV2 is our follow-up to StreamDiffusion: #StreamDiffusion powered real products, but temporal consistency still bugged us. We’re fixing that for the community: 🤔Efficiency ≠ live-readiness: many “real-time” video diffusion models are fast, but live streaming demands per-frame deadlines with low jitter. StreamDiffusionV2 balances temporal stability with strict per-frame deadlines, achieves fast interaction, and is ready for your AI Youtuber Stream Live👇 📒Project page: streamdiffusionv2.github.io 💻Code: github.com/chenfengxu714/…
English
11
45
218
20.3K
Thom retweetledi
Daydream
Daydream@DaydreamLiveAI·
🇫🇷Paris, we’re bringing real-time video AI to the stage! Thom Shutt (@TLivepeer) our director of engineering is presenting at @ParisVideoTech meetup on September 18th. Come check out live video transformed frame-by-frame, in real time!
Daydream tweet media
English
0
3
8
318
Thom
Thom@ThomShutt·
We put Cobol into our SRE job description to filter out AI applications
Thom tweet media
English
0
0
0
74
Thom
Thom@ThomShutt·
Today in "Tripping up AI job applications with a few simple questions". This person is in a constant state of bewilderment.
Thom tweet media
English
0
0
1
57