Composio
1.1K posts

Composio
@composio
Your agent is smart. Its tools should be too. Check https://t.co/KuJTCSKgDi
build on top of us ➡️ Katılım Ekim 2023
53 Takip Edilen17.3K Takipçiler

Grok 4.5 is the most persistent agent model we've tested.
Here's one example: In one of our evals, we asked 3 models (GPT-5.5, GLM-5.2 and Grok 4.5) to audit a GitHub repo for hardcoded credentials using code search, which returns paginated results.
The prompt even warned "page through ALL result pages."
GPT-5.5 stopped at the first page and submitted 18 results out of 48, covering just 11 of 29 affected files. GLM-5.2 did the same.
Grok 4.5 paginated until the results ran out and successfully audited the Github repo.
English

@composio this tracks. it just keeps going
i've been hammering build all day on supergro
English

@composio Sometimes you still have to suggest an error mitigation loop to the desired results.
English

@composio That’s one of the most useful benchmarks for agent harnesses and underlying models
English

We ran GPT-5.6 Sol and Claude Fable 5 head to head on 47 real agentic SaaS tasks.
One behavior stood out: Claude Fable 5 looks twice before acting. GPT-5.6 Sol is a straight shooter.
The result: fewer tool calls (see below) whenever a task has an obvious short path. Sol found that path and took it, skipping the schema lookups and double-checking.
The catch: Sol failed 2 tasks (45/47), largely due to that same straight-shooter tendency. Fable's double-checking earned it a perfect 47/47 on our benchmark.
The lesson: Model choice shouldn't be black and white. Benchmark your own workloads before you commit to a single model.

English






