Sid Shanker retweetledi
Sid Shanker
692 posts

Sid Shanker
@sidpshanker
tools for AI builders @basetenco. Non-dairy with the glasses
New York, NY Katılım Nisan 2011
1.2K Takip Edilen819 Takipçiler
Sid Shanker retweetledi

Inkling is live on Baseten.
We’re proud to partner with @thinkymachines to provide day 0 support. Try it here: baseten.co/library/inklin…

English
Sid Shanker retweetledi
Sid Shanker retweetledi

Tutorial on how to use GLM-5.2 in Claude Code (bookmark this)
~4.5x faster & ~5x cheaper compared to Opus 4.8!
1. Install the latest Claude Code
npm install -g @anthropic-ai/claude-code
2. Create an account at baseten.co.
3. Grab an API Key from app.baseten.co/settings/api_k…. Save it for the next step.
4. Edit ~/.claude/settings.json. Open with vim or another editor. Paste the following with your key.
"env": {
"ANTHROPIC_AUTH_TOKEN": “your_baseten_api_key",
"ANTHROPIC_BASE_URL": "inference.baseten.co",
"ANTHROPIC_DEFAULT_HAIKU_MODEL": "zai-org/GLM-5.2",
"ANTHROPIC_DEFAULT_SONNET_MODEL": "zai-org/GLM-5.2",
"ANTHROPIC_DEFAULT_OPUS_MODEL": "zai-org/GLM-5.2"
}
5. Enjoy GLM-5.2 in CC!

English

working at baseten has been a crazy ride, have packed a lot in to the last few years. but we're just getting started 👀
Tuhin Srivastava@tuhinone
English
Sid Shanker retweetledi

@baseten model performance team is absolutely cracked. @Zai_org GLM 5.2 is now 4x faster running at full 1M context!
Already available to use in your favorite coding harnesses, here it is COOKING in @FactoryAI Droid and @opencode
Docs for how to get it in comments
English
Sid Shanker retweetledi

GLM 5.2 is live on Baseten.
5.2 is built for agentic engineering: stronger coding, sharper agentic reasoning, and a long context window built to run hours-long tasks.
Test it today: baseten.co/library/glm-52/

English

Really proud of the team for shipping rolling deploys! This has been a critical part of ensuring our customers can push the latest & greatest perf optimizations into prod fast & without having to spend on a ton of extra GPUs
Sid Shanker@sidpshanker
English

The dirty secret about consumer research? It’s overrun by fraud.
Survey bots. People lying to qualify for interviews.
Today, Pogo is launching the world’s only AI researcher that lets brands talk to verified buyers of any product - at scale, in hours.
Backed by $32M to date.
For 6 years, we’ve built the consumer network that makes research with real, verified buyers possible:
• 3M+ opted-in U.S. consumers
• Visibility into 1 in every 150 U.S. shopping trips
• $470B in observed transactions
• Ranked #1 Loyalty App in the U.S. by Newsweek, two years running
Watch the full story 👇
English

@domwong Congrats on the launch! been so cool to see this play out 😎
English
Sid Shanker retweetledi

At AI infrastructure companies, pricing is part of the product.
Sid Shanker, Engineering Manager at @baseten, helps the team launch new models and hardware without turning monetization into a bottleneck.
“We launch new models and hardware constantly, and pricing them is half the product decision. Orb lets us move at the speed of our roadmap and prioritize delivering value to our customers.”

English
Sid Shanker retweetledi
Sid Shanker retweetledi
Sid Shanker retweetledi

Our engineers just shipped the fastest named entity recognition (NER) inference on the market: 1 ms P50 and 3 ms P99 server-side latency, 7.7x faster than an optimized PyTorch baseline.
The bottleneck in fast NER is rarely the model: it's tokenization, HTTP parsing, networking, and other overhead.
We solved for that and added it to Baseten Embeddings Inference (BEI). Just point it at your model checkpoint, no model changes needed.
Michael Feil@feilsystem
English
Sid Shanker retweetledi
Sid Shanker retweetledi

there's honestly so much to learn in this space today -- philip's book is the best way to start
Philip Kiely@philipkiely
Inference Engineering launches today. baseten.com/inference-engi…
English






