Sabitlenmiş Tweet
CuiMao
15.7K posts
CuiMao
@CuiMao
AI Developer | NVIDIA YES 深度学习 | 不接广告 Github https://t.co/CRpiUABJoL 免费AI学习群 https://t.co/Ha8LFayYSN
Los Angeles, CA Katılım Ağustos 2022
1.3K Takip Edilen61K Takipçiler
CuiMao retweetledi
🦀 The Rust frontend is officially merged into vLLM!
As GPUs get faster, the frontend has become a real share of CPU time. The new Rust frontend is a drop-in alternative to the Python API server — same engine, same ZMQ boundary. Opt in with VLLM_USE_RUST_FRONTEND=1.
Early numbers: on a preprocess-heavy workload, ~837 req/s vs ~162 req/s for default Python — ~5x in a single process.
A few design choices we're excited about:
• Layered crates with clear boundaries
• Stream-native pipeline — non-streaming for free
• Builds on stable Rust
Huge thanks to @BugenZhao from @inferact for introducing the work at @PyTorch Meetup Singapore.
github.com/vllm-project/v…
English
Please spend 15 minutes watching these films. They will radically change your sense of timelines and your understanding of what is now possible.
We have shown these films in private pre screenings to some of the world’s leading producers, directors, actors, writers, press, and creative minds. The consensus was pretty unanimous: AI has crossed a meaningful threshold in both quality and its potential for complex, layered storytelling.
Runway@runwayml
Introducing Project Luxo: a new initiative exploring how AI-generated video has crossed the uncanny valley. Over the past few weeks, we’ve shared a series of short films with Hollywood executives, producers, directors, writers, actors and reporters. The response has been unanimous: the technology is finally good enough to disappear behind the story. One of those films is The Rogue — a fully AI-generated, ten-minute film that spent over a decade unproduced in the traditional system: too expensive, too difficult, too risky. Created with Runway in under a month by a single person. Learn more about The Rogue and Project Luxo at the link below.
English
达子现在跪在显卡GB300上，可没这功夫反馈。
安子家员工拿着小视频找老板娘告状啦，
老板娘揪着达子的耳朵劈头盖脸一顿骂
“哟呵，你说你去中国出差，原来是约会十年前的旧情人去啦，外面小视频传得满天飞”
达子现在每天做梦都喃喃念叨着
“大意失荆州啊，我女儿都上初中了，谁曾想在AI视频领域翻了船，早知道不做coding agent 了”
中文
我靠他吗 吓死我了
我还是没回 装死 突然发现给我连发了28条消息…
点开一看 给我发了27条的存款单…
这是啥操作？账号咋还被投诉了
是给每个妹妹都发一份吗 太恐怖了 装死两天给他删了 我他妈现在删怕他急了小号加我或者干啥 装死装死🙃🙃🙃🙃
尤可欣Isadora@isadora288881
给他微信小号了但是加了没通过 又加我我忘了是谁来着通过了… 这该怎么回？
中文
