
Ayushman Singh
41 posts

Ayushman Singh
@ayush1399
LLM Inference @Sesame. Views are my own.













Introducing ChatGPT Work, a new agent in ChatGPT powered by Codex and GPT-5.6. It can take action across your apps and files, stay with a project for hours if needed, and turn a goal into finished work. It’s a whole new way to get work done.


There’s hope in hard questions.








And it's not locked to DeepSeek's checkpoints. 🧩 The Speculators library (github.com/vllm-project/s…) lets you train and package DSpark draft models in a standard, HF-compatible format that vLLM loads directly. Already validated on Qwen3-8B and GLM-5.2. Run it on vLLM nightly now: vllm serve zai-org/GLM-5.2-FP8 -tp 8 --speculative-config '{"method":"dspark","model":"RedHatAI/GLM-5.2-speculator.dspark-preview","num_speculative_tokens":7,"attention_backend":"FLASH_ATTN","draft_sample_method":"greedy"}' speculators support PR: github.com/vllm-project/v… Thanks to the @RedHat_AI team for the Speculators integration! 🙏










