Marco

78 posts

Marco

Marco

@marc0ge0

gemini eval @googledeepmind

New York, NY Katılım Aralık 2014
962 Takip Edilen82 Takipçiler
Marco
Marco@marc0ge0·
@finkd wow, congrats to the team
English
0
0
0
10
Mark Zuckerberg
Mark Zuckerberg@finkd·
(1) Today we're releasing Muse Spark 1.1 -- a strong agentic and coding model at a very low price. It's available through our new Meta Model API and in Meta AI.
English
5.2K
3.6K
45.5K
23.1M
Cursor
Cursor@cursor_ai·
We've partnered with SpaceXAI to train Grok 4.5. It’s our most powerful model yet and the first we've built for more than software engineering.
Cursor tweet media
English
729
1.5K
17.7K
5M
Marco retweetledi
albina
albina@enjojoyy·
So GRPO is just an extremely unintuitive term for A/B testing
English
1
1
8
1.6K
Ayushi☄️
Ayushi☄️@iyoushetwt·
Can someone explain why this is still a thing on macOS?
Ayushi☄️ tweet media
English
73
7
1K
202.9K
Aditya
Aditya@adityab29_·
harness does play an important role after all
Aditya tweet media
English
130
48
2.5K
465.2K
Junlong Li
Junlong Li@lockonlvange·
Introducing Toolathlon-Verified 🛠️ Hi all! We did something not fancy at all (and honestly very boring): we fixed the Toolathlon benchmark by correcting tasks, aligning graders, isolating state, hardening the infrastructure, and more—so failures reflect model capabilities and reveal meaningful gaps between models, rather than benchmark bugs. Toolathlon-Verified is not perfect, and we always welcome more feedback to further improve the benchmark. Check here for more information: Repo: github.com/hkust-nlp/Tool… New leaderboard: toolathlon.xyz/docs/leaderboa… Release blog post: toolathlon.xyz/docs/blog/tool… Archived trajectories: huggingface.co/datasets/hkust… Special thanks my deeply admired supervisor @junxian_he for his outstanding contributions to fixing Toolathlon, and to the many community members who shared valuable feedback along the way. Thanks again to everyone who is interested in or using Toolathlon. If possible, please switch to—and enjoy—Toolathlon-Verified!
Junlong Li tweet media
English
2
11
57
8K
Matt Krisiloff
Matt Krisiloff@mattkrisiloff·
I’m so excited to share this update on @Conception – We’ve generated the first early human eggs derived from stem cells. This is a big deal -- the potential to redefine fertility is real.
Matt Krisiloff tweet media
English
439
900
6.5K
2.5M
Marco
Marco@marc0ge0·
neat
Brian Armstrong@brian_armstrong

How to keep AI spend flat while token usage grows exponentially: Not with friction and spend alerts. With better defaults, routing, and caching. Better Defaults (not Usage Caps) – Engineers can choose any model they want, but defaults matter. We’re experimenting with defaulting to open weight models like GLM 5.2 and Kimi 2.7 through our LLM gateway, while still encouraging engineers to choose the right model for the task. 91% of our employees were never hitting their usage caps, so instead of lowering caps and driving up alerts, we're moving to cheaper defaults. Note that code reviews use a diversity of models, so they can check each other's work. Better Routing – In our custom harnesses, we preprocess prompts and route to the best model for the job, considering cache hits and model pricing. For instance, you may want a frontier model for planning, but not for execution where they can be overkill. Ultimately, humans shouldn't be choosing models - AI can automate this task. Better Caching – Cache misses are the easiest way to drive your cost up. All of our requests are cache aware, so we’re reusing a warm cache wherever possible. For example, our cache hit rate went from 5% → 60% in LibreChat once properly implemented. Keep Context Lean – Start fresh sessions when switching tasks. Scope file context narrowly. Disconnect unused tools. Don't just compact. The goal isn't fewer tokens used, it's fewer tokens wasted. Better Visibility – Our engineers can use as many tokens as they want, from whatever model they want, but we’ve made usage visible – and the more you spend on AI, the more impact we expect. The goal isn't to suppress usage. It's to build the infrastructure that makes exponential growth sustainable. Putting this into practice has cut our AI spend nearly in half, while our token usage continues to grow.

English
0
0
1
104
Marco retweetledi
Tim Hua 🇺🇦
Tim Hua 🇺🇦@Tim_Hua_·
This graphic looks terrifying kudos to whoever made it.
English
240
517
12.2K
774.1K
Marco retweetledi
Google Gemma
Google Gemma@googlegemma·
Meet Gemma 4 12B! A unified, encoder-free multimodal model designed to bring high-performance intelligence directly to your laptop, and released under an Apache 2.0 license. Bridging the gap between edge efficiency and advanced reasoning. Here is what’s new with Gemma 4 12B: 👇
Google Gemma tweet media
English
401
1.7K
12.3K
3.2M
Jaidev Shah
Jaidev Shah@JaidevShah4·
Long overdue update but when better than the night before #GoogleIO :) I joined @GoogleDeepMind earlier this year to push the frontier of personalization and memory for Gemini Continual learning and memory is one of the most important and interesting challenges in AI today. Creating deeply empowering and rich experiences requires building systems and models that truly adapt to you and your goals. Excited to share more about what I’ve been a part of- both tomorrow and beyond @GeminiApp
Jaidev Shah tweet media
English
12
9
321
17.7K
Andrej Karpathy
Andrej Karpathy@karpathy·
Personal update: I've joined Anthropic. I think the next few years at the frontier of LLMs will be especially formative. I am very excited to join the team here and get back to R&D. I remain deeply passionate about education and plan to resume my work on it in time.
English
8K
11.1K
150.1K
27.7M
Marco
Marco@marc0ge0·
@MTSlive @grok what’s the timeline he has to build the colony by?
English
1
0
1
21.6K
MTS
MTS@MTSlive·
SITUATION DETECTED: SpaceX has approved a new compensation package for Elon Musk ahead of its IPO. 200M super-voting shares if SpaceX hits a valuation of $7.5T and establishes a Mars colony of 1M people. He gets nothing if they miss targets.
English
71
23
1.1K
767K
vidy
vidy@vidythatte·
PERSONAL NEWS After spending my entire 20s building my startup and shipping countless apps, I’m making a big leap and joining Deepmind! Going to be working with the legendary @ammaar and @GoogleAIStudio team to launch a really cool app very very soon!
vidy tweet mediavidy tweet mediavidy tweet media
English
94
6
735
43K
Marco retweetledi
Benedict Kerres
Benedict Kerres@benedictk__·
Benchmarks lose credibility when rankings diverge from real-world experience. So when a benchmark ranks Muse, Kimi, GLM, Sonnet (no offense I like them) above GPT-5.5 you’re kind of questioning the benchmark. Arena AI does a crowdsourced Elo ranking of LLMs based on human preference, not a controlled benchmark. It measures what users like in pairwise comparisons, which can diverge sharply from real-world usage. Also it's very easy to get the model name - you can make this a non blind test.
Benedict Kerres tweet media
Arena.ai@arena

GPT-5.5 by @OpenAI is now live in the Arena, landing across multiple leaderboards. Here’s how it ranks by modality: - Code Arena (agentic web dev): #9, a strong +50pt jump over GPT-5.4 - Document Arena (analysis & long-content reasoning): #6, on par with Sonnet 4.6 - Text Arena: #7, Math #3, Instruction Following: #8 - Expert Arena: #5 - Search Arena: #2 - Vision Arena: #5 Strong, well-rounded performance, especially in Code (+50 pts vs GPT-5.4). Congrats to @OpenAI on the release. Full category breakdowns by modality in the thread.

English
6
4
62
6K
Marco
Marco@marc0ge0·
@arena @OpenAI benchmarks are saturating at alarming rates
English
0
0
0
1.1K
Arena.ai
Arena.ai@arena·
GPT-5.5 by @OpenAI is now live in the Arena, landing across multiple leaderboards. Here’s how it ranks by modality: - Code Arena (agentic web dev): #9, a strong +50pt jump over GPT-5.4 - Document Arena (analysis & long-content reasoning): #6, on par with Sonnet 4.6 - Text Arena: #7, Math #3, Instruction Following: #8 - Expert Arena: #5 - Search Arena: #2 - Vision Arena: #5 Strong, well-rounded performance, especially in Code (+50 pts vs GPT-5.4). Congrats to @OpenAI on the release. Full category breakdowns by modality in the thread.
Arena.ai tweet media
OpenAI@OpenAI

Introducing GPT-5.5 A new class of intelligence for real work and powering agents, built to understand complex goals, use tools, check its work, and carry more tasks through to completion. It marks a new way of getting computer work done. Now available in ChatGPT and Codex.

English
345
128
1.8K
1.4M
Sam Altman
Sam Altman@sama·
we have updated our partnership with microsoft. microsoft will remain our primary cloud partner, but we are now able to make our products and services available across all clouds. will continue to provide them with models and products until 2032, and a revenue share through 2030.
English
1.2K
811
14K
2.1M