General Reasoning

80 posts

General Reasoning banner
General Reasoning

General Reasoning

@GenReasoning

A long-horizon reinforcement learning company.

London, England Katılım Mayıs 2024
0 Takip Edilen5.4K Takipçiler
Sabitlenmiş Tweet
General Reasoning
General Reasoning@GenReasoning·
🎡📜 We are recruiting for our London chapter. The next era of reinforcement learning is going to be unlike the last, and requires new algorithms, environments and everything inbetween. 🏛️ Shape the next civilisation with us. Link below 👇
General Reasoning tweet media
English
2
5
27
14K
General Reasoning
General Reasoning@GenReasoning·
OpenReward integration for FutureSim by @ShashwatGoel7 and team! 👇 Try it it out
Shashwat Goel@ShashwatGoel7

Major FutureSim updates! 🥽 Visualized trajectories: extremely long horizon, 1000s of actions per run and dozens of compactions, with summaries! Goldmine of interesting agent behaviors across Fable 5, GPT 5.5, GLM 5.2 etc! 📈 @OpenReward integration! You can now use FutureSim, incl. on your own data, with our favourite standard! The @GenReasoning was super supportive in making this happen! Some cool observations in 🧵

English
1
3
13
2.7K
General Reasoning
General Reasoning@GenReasoning·
👇 Come join Ross and Chengxi at @aiDotEngineer World’s Fair next week in SF!
Ross Taylor@rosstaylor90

Excited to be speaking at @aiDotEngineer World’s Fair alongside partner in crime @ChengxiTaylor. It seems we have a lot to talk about: 🤼‍♂️ Actor-critic is hot again? How are current RL algorithms changing with long-horizon rollouts. 🌍 What does a good long-horizon environment look like? How do they differ from terminal based tasks? 🤖 What does good RL infra look like in 2026? Why is long horizon breaking things? As a bonus, I’ll give a run down of our own RL journey starting from Galactica (2021/2022), early SoTA reasoning efforts at Meta (2023), and more. Super fun, high signal-to-noise guaranteed. Come join us!

English
0
2
7
2.5K
General Reasoning
General Reasoning@GenReasoning·
Because of backtest variance, we also record a process-based rubric measure called "sophistication", which we track over time. This uses a human expert rubric to judge the sophistication of the strategies employed. GLM-5.2 shows impressive sophistication compared to other open models, although it still does not surpass the closed SoTA on this metric for any time this year. You can see the full leaderboard and more analysis here: gr.inc/releases/intro…
General Reasoning tweet media
English
0
0
12
2.2K
General Reasoning
General Reasoning@GenReasoning·
We evaluated recent open models on KellyBench. Here is what we found: 🏆 GLM 5.2 is new open source SoTA, but still loses -30% on average over 5 runs. 📈 We estimate GLM 5.2 is 6+ months behind the frontier based on KellyBench and internal quant evaluations. (Note: we have not evaluated Fable) 🌗 Kimi K2.6 slightly improves on Kimi K2.5 but still struggles at -60% average RoI. 🐈 Recent Mistral models struggle, obtaining mean RoIs of -78% and -99% respectively. Leaderboard link and more graphs below.
General Reasoning tweet media
English
2
5
64
21.1K
General Reasoning
General Reasoning@GenReasoning·
🎡📜 We are recruiting for our London chapter. The next era of reinforcement learning is going to be unlike the last, and requires new algorithms, environments and everything inbetween. 🏛️ Shape the next civilisation with us. Link below 👇
General Reasoning tweet media
English
2
5
27
14K
General Reasoning
General Reasoning@GenReasoning·
We've updated the leaderboard with GPT-5.5 results: gr.inc/releases/intro… TLDR: 30% strategy sophistication (new SoTA), much more efficient than GPT-5.4, but still in the red and systematically underperforming human approaches.
General Reasoning tweet media
English
0
0
1
536
General Reasoning
General Reasoning@GenReasoning·
We’re also thankful that KellyBench was featured on the front page of the FT last month! (The British AI neuron has a superposition with football…)
General Reasoning tweet mediaGeneral Reasoning tweet media
English
1
0
4
935
General Reasoning
General Reasoning@GenReasoning·
New models on KellyBench, the benchmark for long-horizon sequential decision making. 🎆 Claude Opus 4.7 - new state-of-the-art, with the highest strategy sophistication recorded on the benchmark (28.5%). But still loses -3.7% on average over five seeds. 🐋 DeepSeek V4 Pro - shows strong feature development capabilities, but scores poorly on overfitting rubrics which harms it in deployment (-47%). Link and more graphs below.
General Reasoning tweet media
English
2
5
92
11.5K
General Reasoning
General Reasoning@GenReasoning·
🌍 Last month we hosted the Complex Worlds Hackathon in London. Participants built an impressive range of environments, spanning synthetic game pipelines, arable farm management, dynamic vehicle routing, hospital triage, robotics, cybersecurity, and more. Congrats to our winners, Julie Huang and Khalid A!
English
3
3
27
5.8K
General Reasoning
General Reasoning@GenReasoning·
🎉 We're now supporting the Agent Data Protocol as a default agentic trajectory format. Any trajectories you log to @OpenReward can be exported in the ADP format. Thanks to @gneubig @yueqi_song for the collaboration!
English
0
10
44
17.6K
General Reasoning
General Reasoning@GenReasoning·
🌍 Environments of the Week It's been a week since we launched @OpenReward. Here are some of our favourite environments this week - some newly added, some heavily used, and some hidden gems. First, the most used environment of the week is EndlessTerminals by @gandhikanishk with 830k+ tool calls. openreward.ai/kanishk/Endles… 🧵
General Reasoning tweet media
English
3
11
54
9.7K
General Reasoning
General Reasoning@GenReasoning·
🎉 Native Harbor support on OpenReward! 🐋 Connect your GitHub repository. We'll build the Docker images for each harbor task and deploy the environment as an API endpoint. 🚂 Train on the deployed tasks with any RL framework. ⚖️ Evaluate on the deployed tasks with any harness. Drop the anchor here and get started below: docs.openreward.ai/environments/d…
English
1
6
25
4.7K
General Reasoning
General Reasoning@GenReasoning·
🔥🐴 Firehorse. Run any model with any harness on any @OpenReward environment. ⚖️ Evaluate the latest models on environment endpoints. 🗂️ Collect agentic data for midtraining and SFT from open models. 🧪 Early experimental library. More support soon. Link below.
English
3
7
34
5.1K